[Feature Request]: Add Sequence - accept a start value from a pipeline field
- Dominant language
- Java
- Stars
- 1.5k
- Forks
- 476
- Avg merge
- 18h 32m
- Merged PRs (30d)
- 216
Description
### What would you like to happen?
Currently Add sequence allows for a database generated sequence or pipeline counter. Not all databases support sequences, to keep code compatible with all databases one would want to use the pipeline counter.
Currently the start value can be hard coded or can be populated from a parameter/variable.
I would like to populate the start value from a field I pass in from a preceding select max() query to get the next sequence.
### Issue Priority
Priority: 3
### Issue Component
Component: Transforms
Contributor guide
Research direction
Start by locating the Add sequence transform and reviewing how its hard-coded or parameter/variable-based start value is handled. Trace how a preceding select max() query exposes a pipeline field, then verify that the transform can use that field as its start value while retaining existing sequence and counter behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100