Running multiple instances of a shell function parallelly [duplicate]

Question

I'm having a shell script as follows.

#!/bin/bash myfunc() { #do something (call a rest service) sleep 300 status=$(get status of the operation performed above) while [ "$status" != "succeeded" ]; do #do something (call a rest service) sleep 300 status=$(get status of the operation performed above) done } a=0 while [ $a -lt 1000 ] do a=`expr $a + 1` myfunc done

In best case, above script takes at least 5*1000=5000 seconds to complete running.

Is there a way to make the myfunc call parallel so that we can let the while loop to spawn multiple running instances of the myfunc??

Note: Somehow, this script should wait until all instances of myfunc executions are completed.

I am not sure if bash does multi threading. You might wanna use some more sophisticated language than shell script to write this ... — mahatmanich
– mahatmanich, Commented Jun 9, 2021 at 14:20
To avoid output from jobs mixing, you can iuse GNU Parallel: export -f myfunc, run parallel myfunc ::: {1..1000} — Ole Tange
– Ole Tange, Commented Jun 13, 2021 at 10:10

Paul Hodges · Accepted Answer · 2021-06-09 14:25:41Z

Put them in background.

while [ $a -lt 1000 ] do echo $a a=`expr $a + 1` myfunc & done wait

Or, in more idiomatic bash,

while (( a < 1000 )) do echo $((a++)) myfunc & done wait

Antonio Petricca · Accepted Answer · 2021-06-09 14:23:26Z

I think you could update your script as follow:

#!/bin/bash myfunc() { job_id=$1 echo "Started job ${job_id}..." #do something (call a rest service) sleep 300 status=$(get status of the operation performed above) while [ "$status" != "succeeded" ]; do #do something (call a rest service) sleep 300 status=$(get status of the operation performed above) done echo "Terminated job ${job_id}." } a=0 while [ $a -lt 1000 ] do echo $a a=(($a + 1)) myfunc $a & done wait echo "Parallel execution terminated."

@AntonioPetricca sorry, I kept it as it is and asked a new question. stackoverflow.com/questions/67923291/… can you check this as well?

Collectives™ on Stack Overflow

Running multiple instances of a shell function parallelly [duplicate]

2 Answers 2

Comments

3 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

3 Comments

Linked

Related