I am accessing a server running CentOS (linux distribution) with an SSH connection. Since I can't always stay logged in, I use "nohup [command] &" to run my programs.
I couldn't find how to get a list of all the programs I started using nohup. "jobs" only works out before I log out. After that, if I log back again, the jobs command shows me nothing, but I can see in my log files that my programs are still running.
Is there a way to get a list of all the programs that I started using "nohup" ?
When I started with $ nohup storm dev-zookeper ,
METHOD1 : using jobs,
prayagupd@prayagupd:/home/vmfest# jobs -l [1]+ 11129 Running nohup ~/bin/storm/bin/storm dev-zookeeper & NOTE: jobs shows nohup processes only on the same terminal session where nohup was started. If you close the terminal session or try on new session it won't show the nohup processes. Prefer METHOD2
METHOD2 : using ps command.
$ ps xw PID TTY STAT TIME COMMAND 1031 tty1 Ss+ 0:00 /sbin/getty -8 38400 tty1 10582 ? S 0:01 [kworker/0:0] 10826 ? Sl 0:18 java -server -Dstorm.options= -Dstorm.home=/root/bin/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dsto 10853 ? Ss 0:00 sshd: vmfest [priv] TTY column with ? => nohup running programs.
Description
Reference
$ man ps # then search /PROCESS STATE CODES
nohup. It lists the processes that are not attached to a TTY, which is a completely different thing: processes started with nohup remain attached to their parent TTY until it is closed; processes that are not attached to a TTY were not necessarily started with nohup. That is, method 2 lists, among other processes, some of the programs running with nohup.
$ ps xw work for me.Instead of nohup, you should use screen. It achieves the same result - your commands are running "detached". However, you can resume screen sessions and get back into their "hidden" terminal and see recent progress inside that terminal.
screen has a lot of options. Most often I use these:
To start first screen session or to take over of most recent detached one:
screen -Rd To detach from current session: Ctrl+ACtrl+D
You can also start multiple screens - read the docs.
If you have standart output redirect to "nohup.out" just see who use this file
lsof | grep nohup.out 
man lsof: "In general threads and tasks inherit the files of the caller, but may close some and open others, so lsof always reports all the open files of threads and tasks." I couldn't find information on nohup in its man, but it seems it uses two threads, not one.
You cannot exactly get a list of commands started with nohup but you can see them along with your other processes by using the command ps x. Commands started with nohup will have a question mark in the TTY column.
You can also just use the top command and your user ID will indicate the jobs running and the their times.
$ top
(this will show all running jobs)
$ top -U [user ID]
(This will show jobs that are specific for the user ID)
sudo lsof | grep nohup.out | awk '{print $2}' | sort -u | while read i; do ps -o args= $i; done returns all processes that use the nohup.out file
From personal experience, I prefer the top command, see javapoint for more examples how to use top. As user Jcrow06 already suggested, running top will show you all running jobs on the server and if one is only interested in the jobs of a specific [userid], one can simply run top -u [userid].
The benefit of running top is that all running processes are shown (including nohup processes, even when started in the background), also ones that are not from the current terminal session or from a different user. Furthermore, one can see with top how much CPU and memory the task takes and for how long it is already running. Which can be helpful to determine if it is still running correctly.
Note top by default orders tasks on CPU usages, but one can adjust the ordering if needed. Furthermore, if you notice unwanted tasks, you can kill them easily by pressing k followed by the processID PID.
