airbytehq / airbytehq/airbyte-python-cdk

Custom components use case analysis: HTTP Requests for Configuration Determination

Offen
#713 0 Kommentare 0 Reaktionen 1 zugewiesene Person Beansprucht von @aaronsteers Auf GitHub ansehen
Vorherrschende Sprache
Python
Sterne
26
Forks
53
Ø Merge
2 T. 6 Std.
Gemergte PRs (30 T.)
10

Beschreibung

This issue documents a use case That requires custom Python. The purpose of this issue is to document the requirement and make a space for discussing if it can be supported in a YAML only format.

## Use Case
Some manifest-only connectors need to make HTTP requests during configuration setup to determine correct API endpoints or extract configuration values before stream processing begins.

## Example Implementation
**source-mailchimp** uses `ExtractAndSetDataCenterConfigValue` to make OAuth metadata requests and extract the data center from authentication credentials:

- Makes HTTP request to OAuth token info endpoint
- Extracts data center from response
- Modifies connector configuration with correct API base URL
- Handles both OAuth and API key authentication methods

**Code Reference:**
https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/source-mailchimp/components.py#L44-L93

## Current Gap
The YAML dialect cannot perform runtime HTTP requests to modify configuration during connector initialization, requiring custom Python components for this functionality.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.