2019-05-14 17:28:06 +00:00
# yq
2018-07-31 09:04:34 +00:00
2020-02-26 10:14:15 +00:00
![Build ](https://github.com/mikefarah/yq/workflows/Build/badge.svg ) ![Docker Pulls ](https://img.shields.io/docker/pulls/mikefarah/yq.svg ) ![Github Releases (by Release) ](https://img.shields.io/github/downloads/mikefarah/yq/total.svg ) ![Go Report ](https://goreportcard.com/badge/github.com/mikefarah/yq )
2018-07-10 11:46:36 +00:00
2017-12-17 22:11:08 +00:00
a lightweight and portable command-line YAML processor
2015-09-27 03:29:20 +00:00
2015-10-13 10:31:02 +00:00
The aim of the project is to be the [jq ](https://github.com/stedolan/jq ) or sed of yaml files.
2015-09-27 03:29:20 +00:00
2020-01-29 22:58:21 +00:00
## New version!
V3 is officially out - if you've been using v2 and want/need to upgrade, checkout the [upgrade guide ](https://mikefarah.gitbook.io/yq/upgrading-from-v2 ).
2020-01-11 00:44:02 +00:00
2015-11-20 10:42:45 +00:00
## Install
2020-01-11 00:44:02 +00:00
2020-02-21 10:07:37 +00:00
### [Download the latest binary](https://github.com/mikefarah/yq/releases/latest)
2020-01-30 23:37:27 +00:00
2020-02-21 10:07:37 +00:00
### MacOS:
2017-12-24 19:30:49 +00:00
```
brew install yq
```
2020-04-22 13:29:44 +00:00
### Windows:
```
choco install yq
```
2020-09-13 00:16:24 +00:00
Supported by @chillum (https://chocolatey.org/packages/yq)
2020-04-22 13:29:44 +00:00
2020-09-13 00:09:02 +00:00
### Alpine Linux
- Enable community repo by adding ```$MIRROR/alpine/v$VERSION/community``` to ```/etc/apk/repositories```
- Update database index with ```apk update```
- Install yq with ```apk add yq```
Supported by Tuan Hoang
https://pkgs.alpinelinux.org/package/edge/community/x86/yq
2020-02-21 10:07:37 +00:00
### Ubuntu and other Linux distros supporting `snap` packages:
2018-02-16 16:24:59 +00:00
```
snap install yq
```
2019-03-26 22:27:07 +00:00
#### Snap notes
2020-05-23 14:30:00 +00:00
`yq` installs with [_strict confinement_ ](https://docs.snapcraft.io/snap-confinement/6233 ) in snap, this means it doesn't have direct access to root files. To read root files you can:
2019-03-26 22:27:07 +00:00
```
2020-01-11 05:01:32 +00:00
sudo cat /etc/myfile | yq r - a.path
2019-03-26 22:27:07 +00:00
```
And to write to a root file you can either use [sponge ](https://linux.die.net/man/1/sponge ):
```
2020-01-11 05:01:32 +00:00
sudo cat /etc/myfile | yq w - a.path value | sudo sponge /etc/myfile
2019-03-26 22:27:07 +00:00
```
or write to a temporary file:
```
2020-01-11 05:01:32 +00:00
sudo cat /etc/myfile | yq w - a.path value | sudo tee /etc/myfile.tmp
2019-03-26 22:27:07 +00:00
sudo mv /etc/myfile.tmp /etc/myfile
rm /etc/myfile.tmp
```
### On Ubuntu 16.04 or higher from Debian package:
2020-02-16 19:16:23 +00:00
```sh
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys CC86BB64
2018-06-11 19:44:55 +00:00
sudo add-apt-repository ppa:rmescandon/yq
sudo apt update
sudo apt install yq -y
```
2020-09-13 00:16:24 +00:00
Supported by @rmescandon (https://launchpad.net/~rmescandon/+archive/ubuntu/yq)
2020-02-21 10:07:37 +00:00
2020-01-30 23:37:27 +00:00
### Go Get:
2015-11-20 10:42:45 +00:00
```
2020-01-13 05:58:11 +00:00
GO111MODULE=on go get github.com/mikefarah/yq/v3
2015-11-20 10:42:45 +00:00
```
2018-04-01 09:48:06 +00:00
## Run with Docker
Oneshot use:
```bash
2020-04-17 12:46:20 +00:00
docker run --rm -v "${PWD}":/workdir mikefarah/yq yq [flags] < command > FILE...
2018-04-01 09:48:06 +00:00
```
Run commands interactively:
```bash
2020-04-17 12:46:20 +00:00
docker run --rm -it -v "${PWD}":/workdir mikefarah/yq sh
2019-06-07 12:16:24 +00:00
```
2019-07-22 23:57:58 +00:00
It can be useful to have a bash function to avoid typing the whole docker command:
2019-06-07 12:16:24 +00:00
```bash
2019-07-22 23:57:58 +00:00
yq() {
2020-04-17 12:46:20 +00:00
docker run --rm -i -v "${PWD}":/workdir mikefarah/yq yq "$@"
2019-07-22 23:57:58 +00:00
}
2018-04-01 09:48:06 +00:00
```
2015-10-13 10:31:02 +00:00
## Features
- Written in portable go, so you can download a lovely dependency free binary
2020-03-01 06:15:32 +00:00
- [Colorize the output ](https://mikefarah.gitbook.io/yq/usage/output-format#colorize-output )
2020-01-29 22:58:21 +00:00
- [Deep read a yaml file with a given path expression ](https://mikefarah.gitbook.io/yq/commands/read#basic )
- [List matching paths of a given path expression ](https://mikefarah.gitbook.io/yq/commands/read#path-only )
2020-03-01 06:15:32 +00:00
- [Return the lengths of arrays/object/scalars ](https://mikefarah.gitbook.io/yq/commands/read#printing-length-of-the-results )
2020-01-29 22:58:21 +00:00
- Update a yaml file given a [path expression ](https://mikefarah.gitbook.io/yq/commands/write-update#basic ) or [script file ](https://mikefarah.gitbook.io/yq/commands/write-update#basic )
2017-04-12 11:17:54 +00:00
- Update creates any missing entries in the path on the fly
2020-02-07 00:28:56 +00:00
- Deeply [compare ](https://mikefarah.gitbook.io/yq/commands/compare ) yaml files
2020-01-29 22:58:21 +00:00
- Keeps yaml formatting and comments when updating
2020-01-30 23:32:44 +00:00
- [Validate a yaml file ](https://mikefarah.gitbook.io/yq/commands/validate )
2020-01-29 22:58:21 +00:00
- Create a yaml file given a [deep path and value ](https://mikefarah.gitbook.io/yq/commands/create#creating-a-simple-yaml-file ) or a [script file ](https://mikefarah.gitbook.io/yq/commands/create#creating-using-a-create-script )
- [Prefix a path to a yaml file ](https://mikefarah.gitbook.io/yq/commands/prefix )
- [Convert to/from json to yaml ](https://mikefarah.gitbook.io/yq/usage/convert )
- [Pipe data in by using '-' ](https://mikefarah.gitbook.io/yq/commands/read#from-stdin )
- [Merge ](https://mikefarah.gitbook.io/yq/commands/merge ) multiple yaml files with various options for [overriding ](https://mikefarah.gitbook.io/yq/commands/merge#overwrite-values ) and [appending ](https://mikefarah.gitbook.io/yq/commands/merge#append-values-with-arrays )
- Supports multiple documents in a single yaml file for [reading ](https://mikefarah.gitbook.io/yq/commands/read#multiple-documents ), [writing ](https://mikefarah.gitbook.io/yq/commands/write-update#multiple-documents ) and [merging ](https://mikefarah.gitbook.io/yq/commands/merge#multiple-documents )
2020-06-11 23:30:05 +00:00
- General shell completion scripts (bash/zsh/fish/powershell) (https://mikefarah.gitbook.io/yq/commands/shell-completion)
2015-09-29 00:20:31 +00:00
2020-01-29 22:58:21 +00:00
## [Usage](https://mikefarah.gitbook.io/yq/)
2017-04-13 05:44:31 +00:00
2020-01-29 22:58:21 +00:00
Check out the [documentation ](https://mikefarah.gitbook.io/yq/ ) for more detailed and advanced usage.
2017-04-13 05:44:31 +00:00
2015-09-27 03:29:20 +00:00
```
2017-04-14 02:40:03 +00:00
Usage:
2017-12-17 22:11:08 +00:00
yq [flags]
yq [command]
2015-09-27 03:40:09 +00:00
2017-04-14 02:40:03 +00:00
Available Commands:
2020-06-11 23:30:05 +00:00
compare yq x [--prettyPrint/-P] dataA.yaml dataB.yaml 'b.e(name==fr*).value'
delete yq d [--inplace/-i] [--doc/-d index] sample.yaml 'b.e(name==fred)'
help Help about any command
merge yq m [--inplace/-i] [--doc/-d index] [--overwrite/-x] [--append/-a] sample.yaml sample2.yaml
new yq n [--script/-s script_file] a.b.c newValue
prefix yq p [--inplace/-i] [--doc/-d index] sample.yaml a.b.c
read yq r [--printMode/-p pv] sample.yaml 'b.e(name==fr*).value'
shell-completion Generates shell completion scripts
validate yq v sample.yaml
write yq w [--inplace/-i] [--script/-s script_file] [--doc/-d index] sample.yaml 'b.e(name==fr*).value' newValue
2015-10-05 03:41:01 +00:00
2017-04-14 02:40:03 +00:00
Flags:
2020-06-11 23:30:05 +00:00
-C, --colors print with colors
2020-02-03 05:37:53 +00:00
-h, --help help for yq
2020-02-07 00:26:29 +00:00
-I, --indent int sets indent level for output (default 2)
2020-02-03 05:37:53 +00:00
-P, --prettyPrint pretty print
2020-02-07 00:26:29 +00:00
-j, --tojson output as json. By default it prints a json document in one line, use the prettyPrint flag to print a formatted doc.
2020-02-03 05:37:53 +00:00
-v, --verbose verbose mode
-V, --version Print version information and quit
2015-10-05 23:01:33 +00:00
2017-12-17 22:11:08 +00:00
Use "yq [command] --help" for more information about a command.
2015-09-29 06:29:32 +00:00
```
2020-09-03 00:58:00 +00:00
## Known Issues
- `yq` attempts to preserve comment positions and whitespace as much as possible, but it does not handle all scenarios (see https://github.com/go-yaml/yaml/tree/v3 for details)