Skip to main content

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

3
  • 1
    I think sed doesn't like the 100GB without line endings as it tries to read a single line in its buffer. Commented Apr 15, 2012 at 8:52
  • splitting (irrespective of "where" the cut happens), processing, then reassembling should give however the correct result. Commented Apr 15, 2012 at 9:09
  • 3
    If you truly have a 100GB text file containing a single long line, then you are better off writing a quick C program to do the work. Commented Apr 15, 2012 at 16:28