huggingface / huggingface/candle

Candle cross-encoder model support

Open
#1,399 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

@LaurentMazare
How can I use candle for a cross-encoder from sentence-transformers models (msmarco models: e.g. msmarco-distilroberta-base-v3)?

Does it require differents stack of implementation or can I just use the Bert example as for the embedding example?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing Candle's Bert example and embedding example, then compare them with the sentence-transformers cross-encoder models named in the issue, including msmarco-distilroberta-base-v3. Done would mean establishing whether Candle can support this model and documenting or implementing the required usage.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.