ml-explore / ml-explore/mlx-examples

Support for Nvidia Nemotron and NVLM 1.0

Open
#1,007 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
9k
Forks
1.2k
PR merge metrics
No merged PRs in 30d

Description

Nvidia recently released a few Nemotron models, like Llama-3_1-Nemotron-51B-Instruct. Converting it with MLX gives the following error: "Model type nemotron-nas not supported." Can the Nemotron-family be added, since they're bases on llama3.1 which is supported?

Furthermore, today they released NVLM-72b-D. I'm still downloading this model, but I suppose this one also needs to be added?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the MLX conversion error for Llama-3_1-Nemotron-51B-Instruct and inspect how existing Llama 3.1 support handles model types. Check whether NVLM-72b-D requires the same path, and consider the work done when the named Nemotron and NVLM models convert successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.