fix: reduce e2e test timeouts and add detailed error logging #359
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Reduce pageLoadTimeout from 120s to 30s for faster failures - Add defaultCommandTimeout of 10s - Update all cy.visit() calls to use 30s timeout with failOnStatusCode: false - Add detailed timing logs for page loads in both test suites - Add error logging for uncaught exceptions with context - Log selected tutorial URL in copy-for-llm test for debugging - Add visit timing information to identify slow/hanging pages This will help tests fail fast (within 30s instead of 120s) and provide better diagnostics about which resources are causing page load timeouts.
✅ Deploy Preview for leafy-mooncake-7c2e5e ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
…only The cypress-io/github-action was building the app locally and running tests against localhost, which was slow and unnecessary since we want to test the actual Netlify deploy preview. This change skips the build step and runs tests directly against the Netlify preview URL, making the workflow much faster and testing the actual deployed artifact.
Added detailed diagnostics to identify why tests run locally but timeout in CI: Network Diagnostics: - DNS resolution test for deploy preview - HTTP response time measurements (connect, transfer, total) - Navigation API endpoint connectivity test - All results logged to GitHub step summary Cypress Debugging: - Enabled DEBUG=cypress:server:* for detailed Cypress logs - Added ELECTRON_ENABLE_LOGGING for browser debugging - Added 'time' command prefix to measure test execution time - Kept existing detailed logging in test files This will help us understand: - Network latency from GitHub Actions to Netlify - DNS resolution issues - Whether the deploy preview is actually accessible - Timing breakdown of where delays occur - Any Cypress-specific issues in the CI environment
- Add 2 retries for failed tests in CI (runMode) - Reduce requestTimeout from 30s to 10s - Reduce responseTimeout from 30s to 10s - This will fail faster on network issues and retry intermittent failures
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Problem
E2E tests were taking 18-26 minutes to fail due to page load timeouts. Tests waited 120 seconds per page load, and when pages failed to load (due to hanging resources or network issues), the tests would run for a very long time before reporting failures.
Additionally, there was no visibility into:
Solution
This PR makes tests fail fast (within 30 seconds instead of 120 seconds) and adds comprehensive diagnostic logging to help identify the root cause of timeout issues.
Changes
1. Cypress Configuration (
cypress.config.cjs)pageLoadTimeoutfrom 120s → 30s (4x faster failure)defaultCommandTimeout: 10000(10s for commands)2. Navigation Tests (
helpcenter-navigation-status.cy.js)cy.visit()with explicit 30s timeout3. Copy for AI Tests (
copy-for-llm.cy.js)cypress.logfile (visible in CI)cy.visit()calls with 30s timeoutImpact
Before:
After:
Example Log Output
This will help us quickly identify which pages are problematic and how long they're actually taking to load, enabling faster debugging and resolution of the underlying issues.