ml-explore / ml-explore/mlx-examples

Support for AI21 Jamba-1.5

Open
#1,097 1 comment 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
9k
Forks
1.2k
PR merge metrics
No merged PRs in 30d

Description

I was wondering whether it is possible to add support for Jamba-1.5-Mini (ai21labs/AI21-Jamba-1.5-Mini). The model seems pretty good for its size and has a large context window that seems to hold up the claimed size, as shown with the RULER Benchmark. Thanks in advance!

EDIT: Direct link to the HF-repo: ai21labs/AI21-Jamba-1.5-Mini

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting the repository's existing model examples and how they load Hugging Face models, then compare those entry points with the ai21labs/AI21-Jamba-1.5-Mini repository linked in the issue. Done means the project has documented, working support for Jamba-1.5-Mini, with the relevant example or validation covered by the repository's existing checks.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.