[api / terraform] Ability to include or exclude fields from a stream
- 主要語言
- Python
- 星號
- 22.1k
- 分支
- 5.4k
- 平均合併
- 5 小時
- 30 天內合併 PR
- 671
描述
### Topic
Select fields with API or Terraform
### Relevant information
Hello, Thanks you for helping people with Airbyte, it's one of the best i ever seen !
I was looking to import and export selected fields in streams in connections, with Terraform or the Airbyte API.
I'm talking about these fields:
But, i can only get available fields between a source and a destination (not a connection) with Airbyte API. (link of the "get stream properties" here: https://reference.airbyte.com/reference/liststreams)
It's worse with Terraform, i can't get any informations about fields in a stream. (link of the terraform connection here: https://registry.terraform.io/providers/airbytehq/airbyte/latest/docs/data-sources/connection)
I think it's impossible to include or exclude fields from a stream in a connection with the API or Terraform, it's only possible to do it with the Airbyte UI. I think i am not the only one who wants to do it.
I need it because (despite of using airbyte UI who is beginner-friendly) i need to save the whole configuration of Airbyte in a Terraform file or something else.
Thanks for your help.
貢獻指南
研究方向
Start with the linked API reference for “list streams” and the Terraform connection data-source documentation, then compare the UI’s stream field selection with what each interface exposes. Done means a connection’s stream fields can be included or excluded and the complete configuration can be represented through both the Airbyte API and Terraform.
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- terraform
- 領域
- api, data-engineering
- Issue 類型
- 功能
- 難度
- 5/5
- 預估耗時
- 一週以上
- 活躍度
- 停滯
- 描述清晰度
- 基本清楚
- 新手友好度
- 25/100