huggingface / huggingface/candle
support / examples for roBERTa
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Is there a way to run inference using a roBERTa model without converting it to onnx?
is it just a matter of implementing BERT, and modifying the tokenizer and using the embeddings for predictions like in the similarities example?
```rust
tokenizer.pre_tokenizer = pre_tokenizers.ByteLevel(...)
tokenizer.decoder = decoders.ByteLevel()
tokenizer.post_processor = processors.RobertaProcessing(...)
```
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files or tests. Start by locating the existing BERT implementation and the similarities example, then review how tokenizer configuration is handled; done means documenting or demonstrating a working roBERTa inference path without ONNX conversion.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 32/100