argoproj / argoproj/argo-workflows
Handle CSV rows in WithParam
- Dominant language
- Go
- Stars
- 17k
- Forks
- 3.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 138
Description
# Summary
The `WithParam` field currently supports only JSON and YAML. However, there're several needs in my team that they want to run a step for each rows in a CSV file.
# Motivation
We have CSV files which need to be parsed and run a step for each row.
# Proposal
Either of the following items are possible.
- `WithParam` automatically identify CSV format and parse it.
- Create another field like `WithCSV`.
- Add another field in `outputs` like `converter: csv` and pass converted json to `WithParam`
---
**Message from the maintainers**:
If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.
Contributor guide
Research direction
Start at the WithParam field and inspect how its existing JSON and YAML inputs are parsed and expanded into per-step items. Resolve which of the three proposed interfaces should be supported, then verify that CSV rows can drive one workflow step each and validate the chosen behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100