testcontainers / testcontainers/testcontainers-python
New Container: vLLM
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.3k
- Forks
- 386
- Avg merge
- 4h 40m
- Merged PRs (30d)
- 1
Description
What is the new container you'd like to have?
A vLLM object container would serve testing and usage better.
Why not just use a generic container for this?
The Ollama object is not maintained against Ollama, which causes several issues:
- Performance: Ollama performs poorly with batch sizes of 50+ requests.
- Functionality: The new "search functionality" in Ollama requires
ollama keys, which are not supported in the current object. - Coverage & Quality: Ollama’s coverage and performance are lower compared to vLLM.
Why vLLM?
The vLLM object allows development and testing in a highly configurable, programmatic way, improving the overall testing experience.
Other references
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review the existing Ollama object and the repository’s current container-object organization as the starting points. Done means providing a configurable, programmatic vLLM object suitable for testing and addressing the coverage and performance concerns described in the issue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, python
- Domain
- devtools, testing-qa
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100