airbytehq / airbytehq/airbyte

BigQuery source connector is failing with "Not found: Dataset" error, but the error references a completely incorrect dataset identifier that doesn't exist.

Đang mở
#78,354 3 bình luận 0 reaction 0 người được giao Xem trên GitHub
area/connectors autoteam community connectors/source/bigquery needs-triage team/extensibility type/bug
Ngôn ngữ chính
Python
Star
22.1k
Fork
5.3k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

### Connector Name

source-bigquery

### Connector Version

BigQuery v0.4.5

### What step the error happened?

None

### Relevant information

**Problem**: The connection was working previously but is now consistently failing. The BigQuery source connector is correctly querying the right dataset, but BigQuery returns an error stating it cannot find dataset with a different name - a completely different and non-existent dataset identifier. The user has never queried or configured this malformed dataset name.

**Root Cause:** This appears to be a bug in the BigQuery source connector related to how it handles billing export table names. The connector is somehow corrupting the dataset identifier, extracting parts of the table name, adding a location suffix (`_us`), and combining it with what appears to be a template/sample project name (`tenant-project-billing-sample`). This matches a previously reported GitHub issue [#59675](https://support.airbyte.com/hc/requests/59675) with similar dataset name corruption.

**Verified Data:**
- Table type: BASE TABLE (not a view)
- Table exists and is queryable: 59,380,037 rows, ~50GB
- Metadata query confirms table is valid and accessible
- Source connection test passes successfully
- Connector is making correct API request: `GET .../projects/.../datasets/billing_export_sample/tables`

**Impact**: Critical - the connection has been failing for multiple days (since at least May 16, 2026). This is blocking billing data sync from BigQuery to Snowflake. The user cannot work around this issue without a connector fix.

I add 2 log files: 1 that was successful, 1 that failed.

[successful call.txt](https://github.com/user-attachments/files/28139108/successful.call.txt)
[failed call.txt](https://github.com/user-attachments/files/28139109/failed.call.txt)

** Investigation into why the BigQuery source connector is corrupting the dataset identifier for billing export tables, and either a patch/workaround or connector version update to resolve the issue.

### Relevant log output

```shell

```

### Contribute

- [ ] Yes, I want to contribute

---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/12686

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.