New Container: vLLM

What is the new container you'd like to have?

A vLLM object container would serve testing and usage better.

Why not just use a generic container for this?

The Ollama object is not maintained against Ollama, which causes several issues:

1. Performance: Ollama performs poorly with batch sizes of 50+ requests.
2. Functionality: The new "search functionality" in Ollama requires ollama keys, which are not supported in the current object.
3. Coverage & Quality: Ollama’s coverage and performance are lower compared to vLLM.

Why vLLM?

The vLLM object allows development and testing in a highly configurable, programmatic way, improving the overall testing experience.

Other references

既存の Ollama オブジェクトと、リポジトリにおける現在のコンテナーオブジェクトの構成を出発点として確認します。テストに適した、構成可能でプログラムから利用できる vLLM オブジェクトを提供し、issue に記載されたカバレッジとパフォーマンスに関する懸念に対処できれば完了です。