airbytehq / airbytehq/airbyte

[api / terraform] Ability to include or exclude fields from a stream

未關閉
#36,491 3 則留言 13 個 reaction 已指派 0 人 在 GitHub 檢視
area/documentation team/compose team/documentation
主要語言
Python
星號
22.1k
分支
5.4k
平均合併
5 小時
30 天內合併 PR
671

描述

### Topic

Select fields with API or Terraform

### Relevant information

Hello, Thanks you for helping people with Airbyte, it's one of the best i ever seen !

I was looking to import and export selected fields in streams in connections, with Terraform or the Airbyte API.

I'm talking about these fields:
image

But, i can only get available fields between a source and a destination (not a connection) with Airbyte API. (link of the "get stream properties" here: https://reference.airbyte.com/reference/liststreams)
It's worse with Terraform, i can't get any informations about fields in a stream. (link of the terraform connection here: https://registry.terraform.io/providers/airbytehq/airbyte/latest/docs/data-sources/connection)

I think it's impossible to include or exclude fields from a stream in a connection with the API or Terraform, it's only possible to do it with the Airbyte UI. I think i am not the only one who wants to do it.

I need it because (despite of using airbyte UI who is beginner-friendly) i need to save the whole configuration of Airbyte in a Terraform file or something else.

Thanks for your help.

貢獻指南

開啟貢獻指南

研究方向

Start with the linked API reference for “list streams” and the Terraform connection data-source documentation, then compare the UI’s stream field selection with what each interface exposes. Done means a connection’s stream fields can be included or excluded and the complete configuration can be represented through both the Airbyte API and Terraform.

由索引模型根據 Issue 內容生成。

評估

技術堆疊
terraform
領域
api, data-engineering
Issue 類型
功能
難度
5/5
預估耗時
一週以上
活躍度
停滯
描述清晰度
基本清楚
新手友好度
25/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。