googleapis / googleapis/google-cloud-cpp

bug: Investigate and re-enable disabled benchmark tests

Open
#15,544 0 comments 0 reactions 0 assignees View on GitHub
priority: p3 type: cleanup
Dominant language
C++
Stars
659
Forks
462
Avg merge
1d 2h
Merged PRs (30d)
89

Description

The following benchmark tests are currently disabled in the macOS Kokoro CI build:

- `//generator/integration_tests:benchmarks_client_benchmark`
- `//google/cloud:options_benchmark`

These tests were disabled in `ci/kokoro/macos/builds/bazel.sh` to resolve CI failures and stabilize the build.

This issue tracks the work to:
1. Investigate the root cause of the failures in these benchmarks.
2. Fix the underlying issues.
3. Re-enable the tests by removing them from the `BAZEL_TEST_EXCLUDES` list in the `ci/kokoro/macos/builds/bazel.sh` script.

Contributor guide

Open the contributing guide

Research direction

Start with the two named benchmark targets and inspect their exclusion in ci/kokoro/macos/builds/bazel.sh, especially the BAZEL_TEST_EXCLUDES list. Reproduce the macOS Kokoro failures and investigate their root causes. Done means the underlying issues are fixed, both benchmarks are removed from the exclusion list, and the macOS CI build passes.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
build-system, ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.