Source: Apify - No properties node in stream schema
- 主要语言
- Python
- 星标
- 22.1k
- 派生
- 5.3k
- PR 合并指标
- PR 指标待抓取
描述
## Environment
- **Airbyte version**: Cloud
- **Step where error happened**: Sync job
## Current Behavior
Replication tab is unable to display source schema.
Sync fails due to the following error message:
```
2023-03-30 13:09:55 [42mnormalization[0m > Traceback (most recent call last):
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/bin/transform-catalog", line 8, in
2023-03-30 13:09:55 [42mnormalization[0m > sys.exit(main())
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 111, in main
2023-03-30 13:09:55 [42mnormalization[0m > TransformCatalog().run(args)
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 36, in run
2023-03-30 13:09:55 [42mnormalization[0m > self.process_catalog()
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 64, in process_catalog
2023-03-30 13:09:55 [42mnormalization[0m > processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 55, in process
2023-03-30 13:09:55 [42mnormalization[0m > stream_processors = self.build_stream_processor(
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 146, in build_stream_processor
2023-03-30 13:09:55 [42mnormalization[0m > properties = get_field(get_field(stream_config, "json_schema", message), "properties", message)
2023-03-30 13:09:55 [42mnormalization[0m > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 238, in get_field
2023-03-30 13:09:55 [42mnormalization[0m > raise KeyError(message)
2023-03-30 13:09:55 [42mnormalization[0m > KeyError: "'json_schema'.'properties' are not defined for stream DatasetItems"
```
## Expected Behavior
Connector should be able to recognize dataset schema, and sync successfully.
## Logs
[tyler__airbyte_logs_1689166_txt.txt](https://github.com/airbytehq/airbyte/files/11112458/tyler__airbyte_logs_1689166_txt.txt)
## Steps to Reproduce
1. Setup an Apify Source Connector
2. Sync to any Destination Connector
3. Even if sync is successful no data is synced
贡献指南
评估
这个 Issue 还没有评估数据。