ml-explore / ml-explore/mlx-data
Would an async api have performance gain?
Open
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 483
- Forks
- 62
- PR merge metrics
- No merged PRs in 30d
Description
Fantastic job! But I'd like to ask if there would be some another gains by designing an async implementation and bind them to python with __anext__ and __aiter__, since data loading is highly related to IO.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the existing data-loading API and the Python binding entry points relevant to the proposed anext and aiter methods. Determine whether asynchronous loading would provide measurable performance gains and document the required design, benchmarks, and acceptance criteria before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100