fread memory_limit arg could rbind into single temp jay
Open
fread
new feature
- Dominant language
- C++
- Stars
- 1.9k
- Forks
- 164
- Avg merge
- 7h 31m
- Merged PRs (30d)
- 1
Description
> memory_limit int
...
In the end the returned Frame will be partially composed from data located on disk, and partially from the data in memory. It is advised to either store this data as a Jay file or filter and materialize the frame (if not the performance may be slow).
This FR asks for option for automatic storing data (AFAIU rbind) into single temporary jay file. Could be even the default IMO
Contributor guide
Assessment
This issue has not been assessed yet.