github / github/copilot-sdk

SDK model listing

Open
#2,237 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
10.5k
Forks
1.5k
Avg merge
1d 11h
Merged PRs (30d)
127

Description

## Summary

Add SDK support for listing available models so applications embedding the SDK can discover which models they can use without spinning up the full agent harness. Fabric is the first concrete consumer waiting on this.

## Motivation

Some clients want to embed the SDK and use lightweight primitives (model discovery, inference) without loading the whole harness. Today the only path to model information requires standing up a full session, which is heavier than these clients need.

There are two distinct cohorts:

- **Harness customers that also want primitives.** They run the harness *and* want lightweight primitives like model listing. This issue covers this cohort.

- **Non-harness customers** A separate problem that needs its own discovery — how large the base is and what they require. *(tracked separately.)*

The direction is that the SDK is the front door: clients converge on the SDK rather than integrating against the underlying inference API directly.

## Proposed behavior

- A lightweight "list models" call available across the SDK languages that does **not** require creating a full session.

- A bounded, documented model-list schema (we don't expose the full underlying model set).

- Telemetry/headers that identify the hosting client, following the code-completions pattern for distinguishing embedding applications.

- A scaling story for identity/auth that doesn't require minting a per-client integration ID.

## Open questions

- Where does model listing live — the language-specific SDK or the core runtime?

- What exactly do we expose for model access?

## Next steps

- Nail down Fabric's actual requirements (must-have vs. nice-to-have).

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by clarifying Fabric's must-have requirements and resolving where model listing belongs, what the bounded schema exposes, and how hosting-client telemetry and identity should work; done means an agreed implementation direction for a lightweight SDK call across the SDK languages.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
api
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.