openai / openai/openai-python

Consider enabling HTTP2 by default

Open
#3,476 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
31.6k
Forks
5.7k
Avg merge
1d 6h
Merged PRs (30d)
96

Description

Confirm this is a feature request for the Python library and not the underlying OpenAI API.
  • This is a feature request for the Python library
Describe the feature or improvement you're requesting
Motivation

The OpenAI Python SDK uses httpx as its HTTP client, but HTTP/2 is disabled by default (http2=False in httpx.Client.__init__). This means every SDK user is stuck with HTTP/1.1 unless they manually configure a custom httpx.Client(http2=True) — a detail most users never discover.

Checked against v2.44.0 (latest), the _DefaultHttpxClient (src/openai/_base_client.py:834) still doesn't pass http2=True, and pyproject.toml only declares httpx>=0.23.0, <1 with no [http2] extra:

class _DefaultHttpxClient(httpx.Client):
    def __init__(self, **kwargs: Any) -> None:
        kwargs.setdefault("timeout", DEFAULT_TIMEOUT)
        kwargs.setdefault("limits", DEFAULT_CONNECTION_LIMITS)
        kwargs.setdefault("follow_redirects", True)
        super().__init__(**kwargs)  # http2 defaults to False
Proposed Change
class _DefaultHttpxClient(httpx.Client):
    def __init__(self, **kwargs: Any) -> None:
        kwargs.setdefault("timeout", DEFAULT_TIMEOUT)
        kwargs.setdefault("limits", DEFAULT_CONNECTION_LIMITS)
        kwargs.setdefault("follow_redirects", True)
+       kwargs.setdefault("http2", True)
        super().__init__(**kwargs)

And optionally add an [http2] extra in pyproject.toml:

[project.optional-dependencies]
http2 = ["httpx[http2]"]
Prior Art
  • Anthropic Python SDK (v0.104.1) already passes http2 through to the httpx transport (_base_client.py:871)
  • httpx has supported HTTP/2 since v0.13 (current declared dep is httpx>=0.23.0)
  • The h2 package is lightweight, pure-Python, and widely used
  • HTTP/2 is supported across all major LLM API providers
Compatibility
  • If the user provides a custom http_client, their configuration takes precedence — no breaking change
  • If the server doesn't support HTTP/2, httpx gracefully downgrades to HTTP/1.1 (this has been handled by httpx for years)
  • Connection limits already set by the SDK are fully compatible with HTTP/2
  • No API changes needed — purely internal client configuration
Why Not Just Document It

Users can already do this manually:

import httpx
from openai import OpenAI
client = OpenAI(http_client=httpx.Client(http2=True))

But most users never find this knob. Making it the default means everyone benefits, especially developers using the SDK for production workloads with high request volumes. The downside is negligible: users who don't have h2 installed would get an ImportError at client construction (easily debuggable), or we mitigate this by making h2 optional and wrapping the import.

Additional context

Many popular LLM API providers already support HTTP/2 (confirmed via ALPN h2):

  • OpenAI (api.openai.com)
  • DeepSeek (api.deepseek.com)
  • Anthropic (api.anthropic.com)
Performance Impact

HTTP/2 brings meaningful improvements, especially for chat completions (frequent, streaming requests):

Metric HTTP/1.1 HTTP/2
TLS handshake ~100ms ~67ms (1-RTT)
Single request ~134ms ~123ms
Header compression ✅ HPACK
Multiplexing ❌ (6 conn/browser limit) ✅ (1-2 connections)
Connections for 10 requests 10 1-2

The biggest win is connection reuse + multiplexing. In HTTP/1.1, every concurrent or back-to-back request opens a new TCP+TLS handshake. With HTTP/2, a single persistent connection handles multiple concurrent requests — critical for streaming chat.completions.create(stream=True) where the SDK opens many chunks over the same connection. Real-world test on DeepSeek API showed TLS handshake dropping from ~100ms to ~67ms just from HTTP/2's 1-RTT TLS.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with _DefaultHttpxClient in src/openai/_base_client.py and the dependency declarations in pyproject.toml. Determine how enabling HTTP/2 should handle the h2 dependency and existing custom http_client behavior; the work is done when the default client uses HTTP/2 without disrupting HTTP/1.1 fallback or user-provided clients.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.