[GSProcessing] Add CSV/JSON input for GSProcessing Custom Split
Open
0.5
- Dominant language
- Python
- Stars
- 452
- Forks
- 76
- PR merge metrics
- No merged PRs in 30d
Description
Currently we only support parquet input for GSProcessing Custom Data Split input, we should support csv/json input as well. Also we should check if we support that for GConstruct.
Contributor guide
Research direction
Locate the GSProcessing Custom Data Split input handling and compare its current parquet path with the corresponding GConstruct support. Determine the changes needed for CSV and JSON inputs in both areas, then verify that each accepts those formats while preserving the existing parquet behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100