[Python] Support for reading .csv files from a zip archive
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
### Describe the enhancement requested
I would like to read CSVs from *.zip archives. The supported compression formats include gzip and bz2, but not zip.
Would it be possible to add zip support?
Supporting zip archives would allow Airbyte to use pyarrow to read CSVs from compressed ZIP archives.
I looked around to see if anything had been proposed about this before, but I couldn't find anything and browsing through the sources, I have difficulty to determine how easy/hard it would be to contribute a fix.
### Component(s)
Python
Contributor guide
Research direction
Start by locating pyarrow's Python CSV reader and the existing gzip and bz2 input handling; the issue does not name specific files or tests. Done means the Python API can read CSVs from .zip archives, with tests covering the requested archive behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100