Rowversion decorator
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 610
- Forks
- 62
- Avg merge
- 1d 23h
- Merged PRs (30d)
- 3
Description
Problem statement
My team and I are building a lightweight masterdata management tool using Rayfin. In order to have a fallback to loading data from the fabric app sql server using cdf into our append-only raw lakehouse, we need a reliable watermark column in each table. That way we can easily incrementally load and store all revisions of each managed entity in our raw lakehouse even if we for some reason end up out of sync with the change data feed.
Proposed solution
Add a rowversion decorator that can be applied to tables that need a reliable watermark column for incremental downstream load/transformation
Alternatives considered
No response
Additional context
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file or test is named in the issue. Start by locating the existing table decorators and the SQL Server integration, then determine how a rowversion column should be represented and exposed. Done means tables can opt into a reliable rowversion watermark for incremental loading while preserving all entity revisions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- sql
- Domain
- data, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100