googleapis / googleapis/google-cloud-python

BigQuery queries intermittently fail with "Dataset not found in location US" despite dataset being in us-central1

Open
#15,691 4 comments 0 reactions 0 assignees View on GitHub
api: bigquery priority: p3 type: bug
Dominant language
Python
Stars
5.4k
Forks
1.8k
Avg merge
3d 4h
Merged PRs (30d)
122

Description

Some of are queries are failing rarely (a few times a week) with this error: Not found: Dataset my-dataset:my_table was not found in location US.
This is because of the correct location is `us-central1`. And more than 99.99% of our queries succeed, so it's not a configuration issue.

We set the correct location with
```python
bigquery.Client(
project=self.project_id,
location=self.location,
)
```

#### Environment details

- OS type and version: Linux, python:3.11.4 docker image
- Python version: 3.11.4
- `google-cloud-bigquery` version: 3.38.0

#### Steps to reproduce

We can't reproduce it deterministically, it happens on a large production system with many concurrent queries.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.