NVIDIA / NVIDIA/SkillSpector

Current GPT Model Budgets (`openai` + `azure_openai`)

Open
#538 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
17.9k
Forks
1.5k
Avg merge
5d 10h
Merged PRs (30d)
66

Description

As a SkillSpector user on OpenAI or Azure OpenAI, I want the bundled registries to know current GPT models — including GPT-6 Astra — so semantic scans of complex code get accurate token budgets instead of the 128K fallback.

The gap

The openai registry knows only gpt-5.4 (at a stale 1M context) and the azure_openai registry stops at GPT-4, so current models silently fall back to the package-wide default budget. Azure users on private endpoints are affected the same way, since deployments resolve by model name.

What I am asking for

Please consider adding the verified current generation to both bundled registries: the GPT-5 line at 400K/128K and the 1.05M line (gpt-5.4 corrected, gpt-5.5, the 5.6 family, gpt-6-Astra) at 1.05M/128K, with lookup tests in the existing style. Done when get_context_length/get_max_output_tokens return documented budgets for these IDs on both providers, with no code or default-model changes.

This could be achieved by

  • Adding the 13 entries per provider to src/skillspector/providers/openai/model_registry.yaml and src/skillspector/providers/azure_openai/model_registry.yaml, each block citing its official source and verification date
  • Annotating the -codex entries as Responses-API-only (this provider speaks chat completions) and omitting IDs with no general release (base gpt-5.3) or unverified numbers (gpt-4.1, o-series)
  • Extending tests/unit/test_providers.py and tests/unit/test_new_providers.py with test_metadata_gpt5_generation / test_metadata_flagship_generation loops

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the existing entries in src/skillspector/providers/openai/model_registry.yaml and src/skillspector/providers/azure_openai/model_registry.yaml, then read the lookup patterns in tests/unit/test_providers.py and tests/unit/test_new_providers.py. Add the verified model metadata and cited sources, extend the named generation tests, and confirm both providers return the documented context and output budgets without changing code or defaults.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
testing-qa, tooling
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Clearly specified
Newbie friendliness
84/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.