How to sample nearby items while keeping performance?
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 206
- PR merge metrics
- No merged PRs in 30d
Description
Each of my streams is ordered, and I'd like to be able to sample N (4 ish) nearby items. Is there an idiomatic way to do this in Mosaic while keeping shard pre-download etc?
Concretely, what I want is to be able to express:
stream ~ p(streams)
s_i, s_i+1, s_i+2, s_i+3 ~ p(stream)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue does not name files, tests, or an entry point. Start by tracing how ordered streams, stream sampling, and shard pre-download are currently handled. Done would be an idiomatic way to sample about four nearby items from a selected stream without losing the existing pre-download performance.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100