lance-format / lance-format/lance
Add RleDataGen in `lance-datagen`
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
Can we keep this in the lance-datagen package? It seems generally useful. Also, we might be able to implement it as a generic "repeat" generator that repeats elements from an underlying generator (either in fixed run lengths or random run lengths)
Can do in a follow-up too
Originally posted by @westonpace in https://github.com/lancedb/lance/pull/4380#discussion_r2252276297
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in the lance-datagen package by reviewing its existing data generators and the discussion in pull request #4380. Implement the requested RleDataGen there, with a generic repeat generator as an optional follow-up. Done means the package exposes the requested generator and its behavior is covered by the package's existing checks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100