airbytehq / airbytehq/PyAirbyte

Cache BigQuery: Invalid value for type: DECIMAL(38, 9) is not a valid value

Đang mở
#573 11 bình luận 1 reaction 0 người được giao Xem trên GitHub
accepting pull requests
Ngôn ngữ chính
Python
Star
344
Fork
77
Merge trung bình
1 ngày 11 giờ
Pull request đã merge (30 ngày)
35

Mô tả

I am running the latest version (0.22) but I am getting errors when trying to use the BigQuery cache. On `source-facebook-marketing`, `source-quickbooks` and `source-xero` I get the following trace

`Traceback (most recent call last):
File "/Users/andrei/Work/cedara/pyairbyte/export_quickbooks.py", line 59, in
result = source.read(cache=cache)
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/sources/base.py", line 659, in read
result = self._read_to_cache(
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/sources/base.py", line 743, in _read_to_cache
cache._write_airbyte_message_stream( # noqa: SLF001 # Non-public API
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/caches/base.py", line 325, in _write_airbyte_message_stream
cache_processor.process_airbyte_messages(
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/shared/sql_processor.py", line 315, in process_airbyte_messages
self._write_all_stream_data(
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/shared/sql_processor.py", line 329, in _write_all_stream_data
self.write_stream_data(
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/shared/sql_processor.py", line 748, in write_stream_data
temp_table_name = self._write_files_to_new_table(
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/airbyte/_processors/sql/bigquery.py", line 178, in _write_files_to_new_table
load_job = client.load_table_from_file( # Make an API request
File "/Users/andrei/Work/cedara/pyairbyte/python310/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 2601, in load_table_from_file
raise exceptions.from_http_response(exc.response)
google.api_core.exceptions.BadRequest: 400 POST https://bigquery.googleapis.com/upload/bigquery/v2/projects/REDACTED/jobs?uploadType=resumable: Invalid value for type: DECIMAL(38, 9) is not a valid value`

It's working correctly when I use `source-faker` (with both `users` and `purchases` streams).

Any idea what's going on?

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.