Skip to main content

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

6
  • $\begingroup$ Could you tell me more about how to use the awk to watch the data as it is being calculated, I am not sure how to do it? And is it necessary that I tar all the data into a single file before I download them? $\endgroup$ Commented Oct 11, 2021 at 18:18
  • 1
    $\begingroup$ @Jack It's not necessary to tar all the data into one file, but it can have some benefits (speed of file transfer often being one of them). If you ask a new question about using awk command to watch data, and you provide your specific output file and which numbers in it that you want to watch, I can try to help you. Today is a holiday in my country (Thanksgiving in Canada) so I might not be able to reply immediately, but I'll try to reply as soon as I can. $\endgroup$ Commented Oct 11, 2021 at 18:22
  • 1
    $\begingroup$ Thanks a lot for the help. I will also try to organize my need and make it neat. I really appreciate your kindly help, Happy Thanksgiving! $\endgroup$ Commented Oct 11, 2021 at 18:28
  • 2
    $\begingroup$ @Jack I watch my data during calculation using tail -f yourlogfilename.log $\endgroup$ Commented Oct 12, 2021 at 16:00
  • $\begingroup$ @NikeDattani In some cases downloading output files could become cumbersome especially, if you HPC admin has setup some security measures that might prevent upload and download of heavy files from the remote instance. $\endgroup$ Commented Oct 13, 2021 at 5:02