spring-projects / spring-projects/spring-ai
Application does not start when using 2GB+ models
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 9.5k
- Forks
- 2.9k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 6
Description
Bug description
When providing model file that is 2GB+ weight I get Caused by: ai.onnxruntime.OrtException: Error code - ORT_RUNTIME_EXCEPTION - message: Exception during initialization: filesystem error: in file_size: No such file or directory ["model.onnx_data"]
Environment
MacOS, org.springframework.ai:spring-ai-starter-model-transformers:1.0.0
Steps to reproduce
Set up SpringAI application. Use jina-embeddings-v3 model
Expected behavior
Application loads with provided model
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the issue in a Spring AI application using the org.springframework.ai:spring-ai-starter-model-transformers:1.0.0 dependency and the jina-embeddings-v3 model on macOS. Investigate the model-loading path for 2GB+ files and the missing model.onnx_data lookup. Done means the application starts and loads the provided model successfully.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100