Draft
Conversation
Collaborator
Generated by 🚫 Danger |
|
Contributor
|
| App Name | WordPress | |
| Configuration | Release-Alpha | |
| Build Number | 31309 | |
| Version | PR #25345 | |
| Bundle ID | org.wordpress.alpha | |
| Commit | 3378454 | |
| Installation URL | 3866bi6qcpatg |
Contributor
|
| App Name | Jetpack | |
| Configuration | Release-Alpha | |
| Build Number | 31309 | |
| Version | PR #25345 | |
| Bundle ID | com.jetpack.alpha | |
| Commit | 3378454 | |
| Installation URL | 7a8ujgo2dqeig |
Contributor
🤖 Build Failure AnalysisThis build has failures. Claude has analyzed them - check the build annotations for details. |
Contributor
Author
|
@wordpress-mobile/apps-infrastructure If I remember it correctly, UI tests used to retry failures, right? It appears that's no longer the case? |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.





Investigated and fixed by Claude Code. The blow is Claude Code's analysis.
UI Test Failure Root Causes
Documented: 2026-03-04
Issue 1: WireMock Not Running
Affected tests: All UI tests
Symptom:
NSURLErrorDomain Code=-1004 "Could not connect to the server."or app crashes on launch.Root cause: The UI tests depend on a WireMock mock server running on
localhost:8282for API mocking. Without it, the app cannot complete any network requests, causing test failures or crashes.Fix: Start WireMock before running UI tests:
See also
API-Mocks/README.mdanddocs/ui-tests.md(step 2:rake mocks).Issue 2: iPad Sidebar Navigation Timeout
Affected tests: All iPad tests that use
makeMainNavigationComponent()(AppSettingsTests, NotificationTests, ReaderTests, etc.)Symptom: Tests timeout with repeated retries, each ~90 seconds apart.
Root cause:
SidebarScreen(inUITestsFoundation) initializes withcollectionViews["sidebar_list"]as its expected element. On iPad, this SwiftUIListwith.listStyle(.sidebar)renders as aUICollectionViewinsideUISplitViewController's sidebar column. Due to a UIKit/SwiftUI accessibility quirk, the CollectionView reportsisAccessibilityElementvisibility as false (isVisible == 0), even though it is rendered on screen and its child elements are visible and interactive. Since ScreenObject waits forisHittable == true(which requiresisVisible == true), the initialization times out after 45 seconds, exceeding the 60-second test timeout.Fix: Changed
SidebarScreen's expected element fromcollectionViews["sidebar_list"]tobuttons["sidebar_me"], which is always present in the sidebar and correctly reports visibility.Issue 3: Block Editor Text View Flakiness (Known, Handled by Retry)
Affected tests: EditorGutenbergTests_01 (
testTextPostPublish,testUndoRedo)Symptom: First attempt fails with "Failed to [tap] not hittable: TextView", but succeeds on retry.
Root cause: The Gutenberg block editor loads its content asynchronously via GutenbergKit (WebView-based). On the first cold launch in a test session, the WebView text views report
isHittable == falseeven though they exist in the accessibility tree with valid frames. XCTest'sdoubleTap()requires hittability, so it fails. On retry, the WebView resources are cached and the text views become hittable quickly.Attempted fixes (coordinate-based tapping,
waitForIsHittablewith various timeouts) either caused the test to hang at later steps or exceeded the test execution time allowance. The WebView text views may never report as hittable on cold start — this appears to be a fundamental limitation of XCTest with WebView-based editors.Mitigation: The test plan uses
retryOnFailuremode (up to 3 attempts). The tests reliably pass on the second attempt. No code change needed.