googleapis / googleapis/google-cloud-python

google-cloud-bigtable system tests are failing with ResourceExhausted

Open
#18,162 1 comment 0 reactions 0 assignees View on GitHub
priority: p1 type: process
Dominant language
Python
Stars
5.4k
Forks
1.8k
Avg merge
3d 4h
Merged PRs (30d)
122

Description

See the failure below where `google-cloud-bigtable` system tests are hitting a quota limit.

`google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com'`

Regrettably, the quota limit is a `system limit`. As per https://docs.cloud.google.com/bigtable/quotas, `System limits are fixed values that can't be changed`.

In PR https://github.com/googleapis/google-cloud-python/pull/18148, we temporarily disabled system tests for `google-cloud-bigtable`. This bug tracks restoring the system tests. In the meantime, we still have emulator tests running.

Contributor guide

Open the contributing guide

Research direction

Start with the google-cloud-bigtable system tests and the temporary disablement in PR 18148, then review the linked Bigtable quota documentation. Compare them with the emulator tests and determine how the system tests can be restored without exceeding the fixed metadata-write quota. Done means the system tests are enabled and pass reliably.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, python
Domain
cloud, databases, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.