vllm-project / vllm-project/aibrix
Public-cloud providers can only fill half of Catalog interface
Open
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 98
Description
seems Catalog interface mixes a generic "what instance types / prices / regions exist" surface with an internal capacity/supply model that public clouds can not populate
ListInstanceTypes / ListPricing / ListRegions => seems these are public cloud fillable.
ListResources/ListResourcePredictions/ListPricingPredictions can not be used in public cloud at this moment
expected or not?
NewCatalog(provider, args...) is constructed without a credential at startup, but live pricing/capacity needs an API key — both providers had to degrade to static tables
Contributor guide
Assessment
This issue has not been assessed yet.