michaelfeil / michaelfeil/infinity

Support Request: Add `voyage-4-nano` Model Integration (Qwen3 Architecture)

Open
#655 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.9k
Forks
206
PR merge metrics
No merged PRs in 30d

Description

Hello Team,

I would like to request support for integrating the new **`voyage-4-nano`** model into the repository/service.

The model appears to be lightweight and optimized for text embeddings, which would be highly beneficial for use cases requiring low-latency and cost-effective embedding generation, such as semantic search, retrieval, and RAG-based applications.

**Request Details:**
Model Link: https://huggingface.co/voyageai/voyage-4-nano
* Please add support for `voyage-4-nano` in the model configuration/interface.
* If applicable, provide example usage in:

* Python
* API / SDK
* Any relevant framework integrations (e.g., LangChain, TEI, or similar)
* Clarify any recommended settings (batch size, dimensions, latency expectations, etc.).

**Use Case (Optional):**
We intend to use this model for:

* Document retrieval
* Semantic search
* Embedding-based ranking in production systems

Please let me know if any additional details are needed from my side.

Thanks in advance for your support!

### Open source status & huggingface transformers.

- [x] The model implementation is available on transformers
- [x] The model weights are available on huggingface-hub
- [x] I verified that the model is currently not running in the latest version `pip install infinity_emb[all] --upgrade`
- [ ] I made the authors of the model aware that I want to use it with infinity_emb & check if they are aware of the issue.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting the repository's model configuration or interface and the current infinity_emb support path for Hugging Face transformer models. Confirm how model names and Qwen3-based architectures are handled, then check the latest installation and relevant serving examples; done means voyage-4-nano is recognized and usable for embedding generation with documented settings or examples where applicable.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
backend, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.