huggingface / huggingface/local-gemma

authentication in LocalGemma2ForCausalLM with huggingface access token doesn't work

Open
#21 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
383
Forks
31
PR merge metrics
No merged PRs in 30d

Description

Authentication in code with token=hf_token doesn't work unless you use subprocess.run("local-gemma", "--token", hf_token, "What is the capital of France")

`model = LocalGemma2ForCausalLM.from_pretrained("google/gemma-2-9b", token=hf_token, preset="memory")
`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at LocalGemma2ForCausalLM.from_pretrained with the token=hf_token example and compare its behavior with the local-gemma --token invocation described in the issue. Reproduce the authentication failure and trace the token handling; done means the from_pretrained call authenticates successfully with the Hugging Face access token.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
ai, authentication
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.