[source-monday] KeyError: 'data'
- 主要言語
- Python
- スター
- 22.1k
- フォーク
- 5.4k
- 平均マージ
- 5時間
- マージ済み PR(30日)
- 671
説明
### Connector Name
Source_monday
### Connector Version
2.30
### What step the error happened?
During the sync
### Relevant information
hi,
While running a sync using the monday.com connector in Airbyte, I encountered a failure due to an attempt to access a missing key in the response JSON. The error occurs when trying to access response.json()["data"], but the "data" key is not present in the response.
Connector: monday.com
Airbyte version: 1.61
Connector version: (2.30
Deployment: Docker
Also i am losing like 5k records on ingest, i think its related to this issue.
thanks in advance
### Relevant log output
```shell
2025-06-13 01:47:55 source ERROR Exception while syncing stream items
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/concurrent/partition_reader.py", line 40, in process_partition
for record in partition.read():
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/stream_slicers/declarative_partition_generator.py", line 59, in read
for stream_data in self._retriever.read_records(self._json_schema, self._stream_slice):
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 469, in read_records
for stream_data in self._read_pages(record_generator, self.state, _slice):
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 381, in _read_pages
next_page_token = self._next_page_token(
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/retrievers/simple_retriever.py", line 309, in _next_page_token
return self._paginator.next_page_token(
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/requesters/paginators/default_paginator.py", line 143, in next_page_token
next_page_token = self.pagination_strategy.next_page_token(
File "/airbyte/integration_code/source_monday/item_pagination_strategy.py", line 92, in next_page_token
data = response.json()["data"]
KeyError: 'data'
2025-06-13 01:47:55 source ERROR Concurrent read failure
Traceback (most recent call last):
File "/airbyte/integration_code/main.py", line 9, in
run()
File "/airbyte/integration_code/source_monday/run.py", line 54, in run
launch(source, _args)
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/entrypoint.py", line 341, in launch
for message in source_entrypoint.run(parsed_args):
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/entrypoint.py", line 171, in run
yield from map(
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/entrypoint.py", line 244, in read
for message in self.source.read(self.logger, config, catalog, state):
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/declarative/concurrent_declarative_source.py", line 154, in read
yield from self._concurrent_source.read(selected_concurrent_streams)
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/concurrent_source/concurrent_source.py", line 119, in read
yield from self._consume_from_queue(
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/concurrent_source/concurrent_source.py", line 144, in _consume_from_queue
if concurrent_stream_processor.is_done() and queue.empty():
File "/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/concurrent_source/concurrent_read_processor.py", line 230, in is_done
raise AirbyteTracedException(
airbyte_cdk.utils.traced_exception.AirbyteTracedException: Concurrent read failure
2025-06-13 01:48:01 destination ERROR main i.a.c.i.u.ConnectorExceptionHandler(handleException):68 caught exception! io.airbyte.commons.exceptions.TransientErrorException: Some streams were unsuccessful due to a source error. See logs for details.
at io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer.close(AsyncStreamConsumer.kt:217) ~[airbyte-cdk-core-0.48.9.jar:?]
at io.airbyte.cdk.integrations.base.SerializedAirbyteMessageConsumer$Companion$appendOnClose$1.close(SerializedAirbyteMessageConsumer.kt:70) ~[airbyte-cdk-core-0.48.9.jar:?]
at kotlin.jdk7.AutoCloseableKt.closeFinally(AutoCloseableJVM.kt:48) ~[kotlin-stdlib-2.0.0.jar:2.0.0-release-341]
at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.kt:215) [airbyte-cdk-core-0.48.9.jar:?]
at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.kt:119) [airbyte-cdk-core-0.48.9.jar:?]
at io.airbyte.cdk.integrations.base.IntegrationRunner.run$default(IntegrationRunner.kt:113) [airbyte-cdk-core-0.48.9.jar:?]
at io.airbyte.integrations.destination.postgres.PostgresDestination$Companion.main(PostgresDestination.kt:230) [io.airbyte.airbyte-integrations.connectors-destination-postgres.jar:?]
at io.airbyte.integrations.destination.postgres.PostgresDestination.main(PostgresDestination.kt) [io.airbyte.airbyte-integrations.connectors-destination-postgres.jar:?]
Stack Trace: io.airbyte.commons.exceptions.TransientErrorException: Some streams were unsuccessful due to a source error. See logs for details.
at io.airbyte.cdk.integrations.destination.async.AsyncStreamConsumer.close(AsyncStreamConsumer.kt:217)
at io.airbyte.cdk.integrations.base.SerializedAirbyteMessageConsumer$Companion$appendOnClose$1.close(SerializedAirbyteMessageConsumer.kt:70)
at kotlin.jdk7.AutoCloseableKt.closeFinally(AutoCloseableJVM.kt:48)
at io.airbyte.cdk.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.kt:215)
at io.airbyte.cdk.integrations.base.IntegrationRunner.run(IntegrationRunner.kt:119)
at io.airbyte.cdk.integrations.base.IntegrationRunner.run$default(IntegrationRunner.kt:113)
at io.airbyte.integrations.destination.postgres.PostgresDestination$Companion.main(PostgresDestination.kt:230)
at io.airbyte.integrations.destination.postgres.PostgresDestination.main(PostgresDestination.kt)
```
### Contribute
- [ ] Yes, I want to contribute
コントリビューションガイド
評価
この issue はまだ評価されていません。