apache / apache/tooling-llmao

db_model: false on a route created via /model/new

Open
#10 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1
Forks
1
PR merge metrics
No merged PRs in 30d

Description

A route created through `/model/new` with `STORE_MODEL_IN_DB=True` comes back
with `model_info.db_model: false`, despite being persisted — it survives and
appears in `/model/info` alongside the YAML-seeded models.

So the flag does not mean what its name suggests, or it is set on the read path
rather than reflecting storage.

Harmless today. Worth pinning down before anything is built that trusts it to
distinguish DB-backed routes from YAML-seeded ones — which is exactly the
distinction "Move fleet state into LiteLLM" and "Surface config skew on the /fleet page" care about, since skew detection needs to know which
routes llmao owns and which came from the seed.

Cheap check: restart the proxy and see whether the flag or the route changes.

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the behavior through /model/new with STORE_MODEL_IN_DB=True, then restart the proxy and inspect the result in /model/info. Compare the db_model flag and route persistence before and after restart; done means the flag accurately distinguishes DB-backed routes from YAML-seeded models.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.