internetarchive / internetarchive/warc
fast seek() for multiprocessing
Open
- Dominant language
- Python
- Stars
- 250
- Forks
- 114
- PR merge metrics
- No merged PRs in 30d
Description
here I want to split warc file to small chunks and then use `multiprocessing` in python
for text file, we can use `seeks`, but how to seek in **warc module or .gz warc files** ??
any advices ?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.