OpenHands / OpenHands/software-agent-sdk
[Bug]: Workers AI broken
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 542
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 137
Description
Is there an existing issue for the same bug?
- I have searched existing issues and this is not a duplicate.
Bug Description
I'm trying to use @hf/thebloke/codellama-7b-instruct-awqbut it's saying The configured model has a context window of 4,096 tokens, which is below the minimum of 16,384 tokens required for OpenHands to function properly. For local LLMs (Ollama, LM Studio, etc.), increase the context window. For cloud providers, verify you're using the correct model variant. For configuration instructions, see: https://docs.openhands.dev/openhands/usage/llms/local-llms To override this check (not recommended), set the environment variable: ALLOW_SHORT_CONTEXT_WINDOWS=true
Even though I have configured it right
Expected Behavior
No response
Actual Behavior
No response
Steps to Reproduce
No response
OpenHands Installation Method
OpenHands Cloud (app.all-hands.dev)
If you selected "Other", please specify
No response
OpenHands Version
Web
Version Confirmation
- I have confirmed this bug exists on the LATEST version of OpenHands
Model Name
@hf/thebloke/codellama-7b-instruct-awq
Operating System
Other
Browser (if using web UI)
Safarl
Logs and Error Messages
litellm.AuthenticationError: AuthenticationError: OpenAIException - {
"error": {
"message": "Incorrect API key provided: cfut_SLa*****************************************335a. You can find your API key at https://platform.openai.com/account/api-keys.",
"type": "invalid_request_error",
"param": null,
"code": "invalid_api_key"
}
}
Screenshots and Additional Context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source file, test, or entry point is identified. Start by reproducing the issue in OpenHands Cloud with the configured @hf/thebloke/codellama-7b-instruct-awq model, then compare the context-window and API-key errors with the provider configuration. Done means the configured model is accepted and requests no longer fail with these errors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, cloud
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100