airbytehq / airbytehq/airbyte-python-cdk

Custom components use case analysis: HTTP Requests for Configuration Determination

未关闭
#713 0 条评论 0 个 reaction 已指派 1 人 已被 @aaronsteers 认领 在 GitHub 查看
主要语言
Python
星标
26
派生
53
平均合并
2 天 6 小时
30 天内合并 PR
10

描述

This issue documents a use case That requires custom Python. The purpose of this issue is to document the requirement and make a space for discussing if it can be supported in a YAML only format.

## Use Case
Some manifest-only connectors need to make HTTP requests during configuration setup to determine correct API endpoints or extract configuration values before stream processing begins.

## Example Implementation
**source-mailchimp** uses `ExtractAndSetDataCenterConfigValue` to make OAuth metadata requests and extract the data center from authentication credentials:

- Makes HTTP request to OAuth token info endpoint
- Extracts data center from response
- Modifies connector configuration with correct API base URL
- Handles both OAuth and API key authentication methods

**Code Reference:**
https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/source-mailchimp/components.py#L44-L93

## Current Gap
The YAML dialect cannot perform runtime HTTP requests to modify configuration during connector initialization, requiring custom Python components for this functionality.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。