4
$\begingroup$

I have a data file (over 2.5 GB) and I want to do calculations on the data.

At first I used.

data=ReadList["file", Record,n] 

I still have three problems:

1- From the Doc of ReadList (ReadList["file",types,n] reads only the first n objects of the specified types) reading starts from the beginning of the file. So how can I read from any part inside the file ( It is clear if I use n the last record, this means I am reading the whole file which I can't).

2- If there is way to read from any part of the file and let us say I want to read the last 1000 objects, how can I know n (last object of the file).

3- The data (after reading) is in this form:

 {" 0.00000E+000\t-9.15527E-004\t", " 2.50000E-006\t-0.0015258789\t", \ " 5.00000E-006\t-0.0018310547\t", " 7.50000E-006\t-0.0015258789\t"} 

I want to create two columns of the data. I used this way:

Interpreter["Number"][ReadList[StringToStream[#], Word] & /@ data] 

As can be seen, I used ReadList twice (one at first reading and one to convert the data). Is there any other efficient way to do this?

Thank you.

$\endgroup$
2

0

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.