vllm-project / vllm-project/aibrix

Public-cloud providers can only fill half of Catalog interface

Open
#2,247 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 20h
Merged PRs (30d)
98

Description

seems Catalog interface mixes a generic "what instance types / prices / regions exist" surface with an internal capacity/supply model that public clouds can not populate

ListInstanceTypes / ListPricing / ListRegions => seems these are public cloud fillable.
ListResources/ListResourcePredictions/ListPricingPredictions can not be used in public cloud at this moment

expected or not?

NewCatalog(provider, args...) is constructed without a credential at startup, but live pricing/capacity needs an API key — both providers had to degrade to static tables

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.