airbytehq / airbytehq/airbyte

[source-sftp-bulk] Data type for columns always inferred as 'string' when parsing CSVs

未關閉
#72,542 5 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
area/connectors autoteam community connectors/source/sftp-bulk needs-triage team/extensibility team/use type/bug
主要語言
Python
星號
22.1k
分支
5.3k
PR 合併指標
PR 指標待擷取

描述

### Connector Name

source-sftp-bulk-zip

### Connector Version

1.81.1

### What step the error happened?

During the sync

### Relevant information

The connectorSpecification for this connector contains the hidden field "inference_type" that defaults to None:
```
# rest of the connector specification omitted
inference_type": {
"title": "Inference Type",
"description": "How to infer the types of the columns. If none, inference default to strings.",
"default": "None",
"airbyte_hidden": true,
"enum": [
"None",
"Primitive Types Only"
]
},
... # snip
```
As a result, data type for all columns [is always inferred as 'string'](https://github.com/airbytehq/airbyte-python-cdk/blob/d3c94190e12864b5ecb918d9ad3cc5bd29514d16/airbyte_cdk/sources/file_based/file_types/csv_parser.py#L188-L194) when parsing CSV files .

Is this behaviour intentional?

### Contribute

- [x] Yes, I want to contribute

---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/11138

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。