huggingface / huggingface/candle

support / examples for roBERTa

Open
#1,367 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Is there a way to run inference using a roBERTa model without converting it to onnx?

is it just a matter of implementing BERT, and modifying the tokenizer and using the embeddings for predictions like in the similarities example?

```rust
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(...)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.RobertaProcessing(...)
```

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests. Start by locating the existing BERT implementation and the similarities example, then review how tokenizer configuration is handled; done means documenting or demonstrating a working roBERTa inference path without ONNX conversion.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
ai, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.