What is best way read 10Gb file | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
0

What is best way read 10Gb file

which language is better for that

20th Apr 2017, 1:06 AM
Maddala Kumar
Maddala Kumar - avatar
1 Answer
+ 8
Not a language related problem, but memory and strategy one... Whatever the language used to read 10Gb file, you'll need to avoid read it at once and buffered it, because reading it at once would require at least 10Gb of memory free on user computer ( at least, because you probably need to do some operation with it, and with bad strategy you will quickly multiply memory requirements and reach a memory overflow error, which can result of brutally power off or freeze the computer :P )
20th Apr 2017, 1:38 AM
visph
visph - avatar