firebase / firebase/firebase-cpp-sdk

[C++] Nightly Integration Testing Report

Open
#1,587 0 comments 0 reactions 0 assignees View on GitHub
nightly-testing
Dominant language
C++
Stars
326
Forks
137
Avg merge
3d 9h
Merged PRs (30d)
5

Description

Note: This report excludes Firestore. Please also check **[the report for Firestore](https://github.com/firebase/firebase-cpp-sdk/issues/1586).**
***

### Testing History (last 7 days)

| Date|Build vs Source Repo|Test vs Source Repo|SDK Packaging|Build vs SDK Package|Test vs SDK Package|Notes |
|---|---|---|---|---|---|---|

View extended history (last 30 days)

### Testing History (last 30 days)

| Date|Build vs Source Repo|Test vs Source Repo|SDK Packaging|Build vs SDK Package|Test vs SDK Package|Notes |
|---|---|---|---|---|---|---|
| 2025‑03‑31|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑01|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑02|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑03|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑04|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑05|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑06|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑07|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑08|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑09|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑10|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑11|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑12|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑13|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑14|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑15|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑16|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑17|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑18|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑19|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑20|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑21|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑22|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |
| 2025‑04‑23|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[❌ **Failure**](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14167888339)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14166919329)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)|[✅ Pass](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14170745563)| Missing test logs on iOS simulator. |

Top 10 flakes/failures (last 30 days)

| # | Latest | Product | Platform | Test Info |
|---|---|---|---|---|
| 4 | [21 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14215658730) | App Check | iOS | [FirebaseAppCheckTest.TestSignIn](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAppCheckTest,%20TestSignIn") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14079279467) [2](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14102628246) [3](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) [4](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14215658730) |
| 2 | [1 day ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14590870512) | App Check | iOS | [FirebaseAppCheckTest.TestDatabaseRunTransaction](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAppCheckTest,%20TestDatabaseRunTransaction") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14102628246) [2](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14590870512) |
| 2 | [27 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14102628246) | Auth | Android | [FirebaseAuthTest.TestSignInWithBadEmailFails](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAuthTest,%20TestSignInWithBadEmailFails") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14079279467) [2](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14102628246) |
| 1 | [1 day ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14590870512) | Auth | iOS | [FirebaseAuthTest.TestUpdateEmailAndPassword](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAuthTest,%20TestUpdateEmailAndPassword") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14590870512) |
| 1 | [1 day ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14590870512) | Auth | iOS | [FirebaseAuthTest.TestVerifyBeforeUpdatingEmail](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAuthTest,%20TestVerifyBeforeUpdatingEmail") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14590870512) |
| 1 | [22 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14191531294) | GMA | Android | Crash or timeout (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14191531294) |
| 1 | [24 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) | Installations | Android | [FirebaseInstallationsTest.TestCanGetToken](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseInstallationsTest,%20TestCanGetToken") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) |
| 1 | [24 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) | Messaging | Android | [FirebaseMessagingTest.TestSendMessageToToken](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseMessagingTest,%20TestSendMessageToToken") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) |
| 1 | [24 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) | App Check | Android | [FirebaseAppCheckTest.TestDebugProviderValidToken](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAppCheckTest,%20TestDebugProviderValidToken") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) |
| 1 | [24 days ago](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) | App Check | Android | [FirebaseAppCheckTest.TestSignIn](http://github.com/search?q=repo:firebase/firebase-cpp-sdk%20"FirebaseAppCheckTest,%20TestSignIn") (flaky)
   Logs: [1](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14154488959) |

📄


***

### ❌  [build against repo] Integration test FAILED
Requested by @DellaBitta on commit 8dee6fea771c795827b454f3b2b1f6a7295a36ef
Last updated: Thu Apr 24 06:43 PDT 2025
**[View integration test log & download artifacts](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14637648195)**
| Failures | Configs |
|----------|---------|
| missing_log | [TEST] [ERROR] [iOS] [macos] [1/6 ios_device: ios_min]
|
| auth | [TEST] [FAILURE] [Linux] [1/2 ssl_lib: x86] [1/2 build_type: openssl](1 failed tests)  FirebaseAuthTest.TestSignInWithBadEmailFails[TEST] [FAILURE] [iOS] [macos] [1/6 ios_device: simulator_latest](1 failed tests)  FirebaseAuthTest.TestSignInWithBadEmailFails |

Add flaky tests to **[go/fpl-cpp-flake-tracker](http://go/fpl-cpp-flake-tracker)**

***
### ❌  [build against SDK] Integration test FAILED
Requested by @firebase-workflow-trigger[bot] on commit 8dee6fea771c795827b454f3b2b1f6a7295a36ef
Last updated: Wed Apr 23 07:25 PDT 2025
**[View integration test log & download artifacts](https://github.com/firebase/firebase-cpp-sdk/actions/runs/14617299094)**
| Failures | Configs |
|----------|---------|
| missing_log | [TEST] [ERROR] [iOS] [macos] [2/6 ios_device: simulator_latest ios_min]
|
| app_check | [TEST] [FLAKINESS] [iOS] [macos] [1/6 ios_device: ios_target](1 failed tests)  FirebaseAppCheckTest.TestSignIn |
| installations | [TEST] [FLAKINESS] [Android] [1/3 os: ubuntu] [1/4 android_device: android_target](1 failed tests)  FirebaseInstallationsTest.TestCanGetToken |

Add flaky tests to **[go/fpl-cpp-flake-tracker](http://go/fpl-cpp-flake-tracker)**

Contributor guide

Open the contributing guide

Research direction

Start with the linked GitHub Actions run in the testing history and inspect the repeated test failure and missing iOS simulator logs. The report does not name a source file, test entry point, or requested change, so confirm the intended fix with maintainers before proceeding; completion criteria are not defined.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, github-actions, ios
Domain
ci-cd, mobile, testing
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.