huggingface / huggingface/candle

Gemma 4 Textmodel doesn't work.

Open
#3,492 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

It looks like the multimodal version works but the text model was never tested.
we tested and tried a bit on this issue but got no traction.
https://github.com/huggingface/candle/issues/3448

thanks

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the linked issue #3448, then reproduce the Gemma 4 text-model failure and compare it with the working multimodal version. Done means the text model works in Candle and the behavior is confirmed by a repeatable test or reproduction.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning, rust
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.