[C++] Nightly Integration Testing Report for Firestore

[github-actions]

Testing History (last 7 days)

Date	Build vs Source Repo	Test vs Source Repo	SDK Packaging	Build vs SDK Package	Test vs SDK Package	Notes
2024‑09‑22	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑23	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑24	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑25	✅ Pass	❌ Failure	✅ Pass	✅ Pass	❌ Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.

View extended history (last 30 days)

Testing History (last 30 days)

Date	Build vs Source Repo	Test vs Source Repo	SDK Packaging	Build vs SDK Package	Test vs SDK Package	Notes
2024‑08‑31	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Missing test logs on iOS simulator and a test flake in Firestore on Android.
2024‑09‑01	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Missing test logs on iOS simulator and a test flake in Firestore on Android.
2024‑09‑02	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Missing test logs on iOS simulator and a test flake in Firestore on Android.
2024‑09‑03	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Missing test logs on iOS simulator and a test flake in Firestore on Android.
2024‑09‑04	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Missing test logs on iOS simulator and a test flake in Firestore on Android.
2024‑09‑05	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	A test error in Firestore on iOS simulator and a test flake in Firestore on Android emulator.
2024‑09‑06	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and test flakes in Firestore on Android and iOS.
2024‑09‑07	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Missing test logs on MacOS and iOS simulator.
2024‑09‑08	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Missing test logs on MacOS and iOS simulator.
2024‑09‑09	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Missing test logs on MacOS and iOS simulator.
2024‑09‑10	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Missing test logs on MacOS and iOS simulator.
2024‑09‑11	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Missing test logs on MacOS and iOS simulator.
2024‑09‑12	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Missing test logs on iOS simulator, and test flakes in Firestore on Android and iOS.
2024‑09‑13	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on MacOS and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑14	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on MacOS and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑15	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on MacOS and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑16	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑17	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑18	✅ Pass	❌ Failure	✅ Pass	✅ Pass	❌ Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.
2024‑09‑19	✅ Pass	❌ Failure	✅ Pass	✅ Pass	❌ Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.
2024‑09‑20	✅ Pass	❌ Failure	✅ Pass	✅ Pass	❌ Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.
2024‑09‑21	✅ Pass	❌ Failure	✅ Pass	✅ Pass	❌ Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.
2024‑09‑22	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑23	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑24	✅ Pass	❌ Failure	✅ Pass	✅ Pass	✅ Pass (flaky)	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024‑09‑25	✅ Pass	❌ Failure	✅ Pass	✅ Pass	❌ Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.

Top 10 flakes/failures (last 30 days)

#	Latest	Product	Platform	Test Info
26	Today	Firestore	Android	Crash or timeout (flaky)    Logs: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26
22	Today	Firestore	iOS	Unspecified test (failure)    Logs: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
9	3 days ago	Firestore	Android	TaskTest.IsCompleteShouldReturnTrueForCanceledTask (flaky)    Logs: 1 2 3 4 5 6 7 8 9
2	15 days ago	Firestore	iOS	Crash or timeout (flaky)    Logs: 1 2
2	15 days ago	Firestore	Android	SourceTest.GetCollectionWhileOnlineWithSourceEqualToCache (flaky)    Logs: 1 2
1	1 day ago	Firestore	Android	AggregateCountTest.TestQueriesCanUseNotInFiltersWithDocIds (flaky)    Logs: 1
1	1 day ago	Firestore	Android	SmokeTest.TestGetCollectionQuery (flaky)    Logs: 1
1	1 day ago	Firestore	Android	QueryTest.TestQueriesCanUseInFilters (flaky)    Logs: 1
1	3 days ago	Firestore	Android	ServerTimestampTest.TestServerTimestampsWorkViaSet (flaky)    Logs: 1
1	4 days ago	Firestore	Android	FieldsTest.TestFieldsWithSpecialCharsCanBeUsedInOrderBy (flaky)    Logs: 1

📄

2024-09-22			Pass	Failure	Pass	Pass	Pass	Test errors including missing logs on iOS simulator and Firestore on iOS simulator, and a test flake in Firestore on Android.
2024-09-23			Pass	Failure	Pass	Pass	Pass (flaky)	'''
2024-09-24			Pass	Failure	Pass	Pass	Pass (flaky)	'''
2024-09-25			Pass	Failure	Pass	Pass	Failure	A test error in Firestore on iOS simulator and a test flake in Firestore on Android.

---

❌  [build against repo] Integration test FAILED

Requested by @sunmou99 on commit 1431a42
Last updated: Thu Sep 26 07:19 PDT 2024
View integration test log & download artifacts

Failures	Configs
missing_log	[TEST] [ERROR] [iOS] [macos] [1/6 ios_device: simulator_latest]
firestore	[TEST] [FLAKINESS] [Android] [1/3 os: macos] [1/4 android_device: emulator_ftl_latest] (1 failed tests)   TaskTest.IsCompleteShouldReturnTrueForCanceledTask [TEST] [FLAKINESS] [Android] [1/3 os: ubuntu] [1/4 android_device: android_target] (1 failed tests)   CRASH/TIMEOUT [TEST] [FLAKINESS] [Android] [2/3 os: ubuntu macos] [1/4 android_device: android_latest] (1 failed tests)   CRASH/TIMEOUT

Add flaky tests to go/fpl-cpp-flake-tracker

---

❌  [build against SDK] Integration test FAILED

Requested by @firebase-workflow-trigger[bot] on commit 1431a42
Last updated: Thu Sep 26 09:14 PDT 2024
View integration test log & download artifacts

Failures	Configs
firestore	[TEST] [ERROR] [iOS] [macos] [1/6 ios_device: simulator_min]

Add flaky tests to go/fpl-cpp-flake-tracker

---

✅  [build against tip] Integration test succeeded!

Requested by @sunmou99 on commit 1431a42
Last updated: Thu Sep 26 04:42 PDT 2024
View integration test log & download artifacts