airbytehq / airbytehq/airbyte

Source: Apify - No properties node in stream schema

未关闭
#24,701 3 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
autoteam connectors/source/apify-dataset Icebox team/extensibility team/marketplace type/bug
主要语言
Python
星标
22.1k
派生
5.3k
PR 合并指标
PR 指标待抓取

描述

## Environment
- **Airbyte version**: Cloud
- **Step where error happened**: Sync job

## Current Behavior
Replication tab is unable to display source schema.
Sync fails due to the following error message:
```
2023-03-30 13:09:55 normalization > Traceback (most recent call last):
2023-03-30 13:09:55 normalization > File "/usr/local/bin/transform-catalog", line 8, in
2023-03-30 13:09:55 normalization > sys.exit(main())
2023-03-30 13:09:55 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 111, in main
2023-03-30 13:09:55 normalization > TransformCatalog().run(args)
2023-03-30 13:09:55 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 36, in run
2023-03-30 13:09:55 normalization > self.process_catalog()
2023-03-30 13:09:55 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 64, in process_catalog
2023-03-30 13:09:55 normalization > processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)
2023-03-30 13:09:55 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 55, in process
2023-03-30 13:09:55 normalization > stream_processors = self.build_stream_processor(
2023-03-30 13:09:55 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 146, in build_stream_processor
2023-03-30 13:09:55 normalization > properties = get_field(get_field(stream_config, "json_schema", message), "properties", message)
2023-03-30 13:09:55 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 238, in get_field
2023-03-30 13:09:55 normalization > raise KeyError(message)
2023-03-30 13:09:55 normalization > KeyError: "'json_schema'.'properties' are not defined for stream DatasetItems"
```

## Expected Behavior
Connector should be able to recognize dataset schema, and sync successfully.

## Logs
[tyler__airbyte_logs_1689166_txt.txt](https://github.com/airbytehq/airbyte/files/11112458/tyler__airbyte_logs_1689166_txt.txt)

## Steps to Reproduce
1. Setup an Apify Source Connector
2. Sync to any Destination Connector
3. Even if sync is successful no data is synced

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。