stacklok / stacklok/toolhive

Embeddings Service Requirement for ToolHive Operator

Open
#6,105 1 comment 0 reactions 1 assignee View on GitHub

@meenacodes is already working on this.

Since Jul 28, 2026.

enhancement kubernetes
Dominant language
Go
Stars
2.2k
Forks
300
Avg merge
1d 15h
Merged PRs (30d)
184

Description

The ToolHive Operator currently requires the CRD to either use the Hugging Face Text Embeddings Inference image (ghcr.io/huggingface/text-embeddings-inference) or configure optimizer.embeddingService with an OpenAI-compatible embeddings endpoint.

For deployments that only require keyword search and do not use semantic search, this dependency on an embeddings service seems unnecessary.

Could you please provide a way to make this optional in the CRD, so that optimizer.embeddingService only needs to be configured when semantic search is explicitly enabled? This would allow keyword-only deployments without requiring an embeddings service.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.