Output redirection to multiple files

Question

I need to run a python script for multiple input files and for each one, I want to generate a new corresponding output file (e.g. for input_16jun.txt I want the output file to be 16jun_output.txt). I tried doing something like:

nohup python script.py input_{16..22}jun.txt > {16..22}jun_output.txt &

But I keep getting "ambiguous redirect" error. Does anyone know how to fix this? Or any other better approach?

Try this - nohup python script.py input_{16..22}jun.txt | tee {16..22}jun_output.txt & — Indra Uprade
– Indra Uprade, Commented Jul 24, 2016 at 2:16
Looks like that ran the script for only one input file and stored the same output in every output file — ion20
– ion20, Commented Jul 24, 2016 at 2:24
i thought your input and output file name is changing in each iteration ? tee would overwrite content in file. — Indra Uprade
– Indra Uprade, Commented Jul 24, 2016 at 2:26

Chris_Rands · Accepted Answer · 2016-07-24 20:11:58Z

Looping over each input file like this with bash should work.

for f in input_*.txt; do python script.py $f > "${f:6:-4}"_output.txt; done

Alternatively if you want to do the loop in a python script.

import glob import os input_files = glob.glob("input_*.txt") for f in input_files: os.system("python script.py {} > {}_output.txt".format(f,f.split("input_")[1].rstrip(".txt")))

If you want to run script.py in parallel (rather than sequentially) you can also consider using the python multiprocessing package.

Collectives™ on Stack Overflow

Output redirection to multiple files

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related