ml-explore / ml-explore/mlx-examples
Support for nanogpt (and gpt-j)
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 9k
- Forks
- 1.2k
- PR merge metrics
- No merged PRs in 30d
Description
I'm hoping to use MLX-LM to try out inference with this new LM specialized for Nigerian languages. It's based on Karpathy's nanogpt (they say it's inspired by GPT-J's architecture—I suspect inferencing over base nanogpt would work). As expected looking at the supported model types list, core MLX doesn't support that. I also see the separate nanoGPT_mlx, but looks like work really slowed down on that.
Supporting a Nigerian language LLM would be a really nice nod to the global south (it includes Pidgin, which is widely spoken in Africa). I think it would also bring a lot of interest to MLX for fast inference as this model develops.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no repository file or test; start with the supported model types list and compare the linked nanogpt and GPT-J architecture references. Done means MLX-LM can perform inference with the linked SabiYarn-125M model and the requested model family.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100