argoproj / argoproj/argo-workflows

Handle CSV rows in WithParam

Open
#3,072 1 comment 3 reactions 0 assignees View on GitHub
area/looping
Dominant language
Go
Stars
17k
Forks
3.7k
Avg merge
1d 20h
Merged PRs (30d)
138

Description

# Summary

The `WithParam` field currently supports only JSON and YAML. However, there're several needs in my team that they want to run a step for each rows in a CSV file.

# Motivation

We have CSV files which need to be parsed and run a step for each row.

# Proposal

Either of the following items are possible.

- `WithParam` automatically identify CSV format and parse it.
- Create another field like `WithCSV`.
- Add another field in `outputs` like `converter: csv` and pass converted json to `WithParam`

---

**Message from the maintainers**:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.

Contributor guide

Open the contributing guide

Research direction

Start at the WithParam field and inspect how its existing JSON and YAML inputs are parsed and expanded into per-step items. Resolve which of the three proposed interfaces should be supported, then verify that CSV rows can drive one workflow step each and validate the chosen behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.