Running grep query on multiple docker container logs filtered by some attribute

Question

I am running multiple docker containers on a remote server which are tagged by my username. The containers run some code with printed outputs. I want to do a string search for string "xyz" using grep on the output of all the containers that belong to me(filter by username). Below is my attempt doing this which doesn't seem to work:

docker ps -a -q --filter name=${USER} --format="{{.ID}}" | xargs -d ' ' docker logs | grep xyz

BONUS: I want a python script that does the above for me on all the servers I am running my containers on, from my macbook, something like this:

 os.system('ssh {}@{} \"docker ps -a -q --filter name={} --format={{{{.ID}}}} | xargs -d ' ' docker logs | grep xyz\"'.format(usern[server], server, usern[server]))

Where "server" is the server name and "usern" is a dict storing my username for that server. My ssh keys are stored.

Obviously I am struggling to make this work too.

What does docker ps -a -q --filter name=${USER} --format="{{.ID}}" output? Then, what does docker ps -a -q --filter name=${USER} --format="{{.ID}}" | xargs -d ' ' docker logs output? — JacobIRR
– JacobIRR, Commented Jun 19, 2019 at 17:00
@JacobIRR Tried this already, first one works fine and lists all the container ID for me. Second one throws "Error: No such container:<container ID of 1st listed container>". — I_am_AM
– I_am_AM, Commented Jun 19, 2019 at 17:05

Mihai · Accepted Answer · 2019-06-19 17:14:32Z

1

docker ps -a -q --filter name=${USER} | while read c; do docker logs $c; done | grep xyz

You should also note that -q and --format="{{.ID}}" are synonyms so only one of them is enough.

answered Jun 19, 2019 at 17:14

Mihai

11k3 gold badges24 silver badges45 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

I_am_AM Over a year ago

Any idea why xargs version fails?

Mihai Over a year ago

I can't give you all the details but in my experience xargs can't handle multi-line inputs.

Collectives™ on Stack Overflow

Running grep query on multiple docker container logs filtered by some attribute

1 Answer 1

2 Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Related