Skip to content

chore(deps): update dependency @playwright/test to v1.53.0 #13567

chore(deps): update dependency @playwright/test to v1.53.0

chore(deps): update dependency @playwright/test to v1.53.0 #13567

Triggered via pull request June 14, 2025 10:35
Status Failure
Total duration 16m 44s
Artifacts 1

ci.yml

on: pull_request
incremental_mutation_testing
1m 28s
incremental_mutation_testing
Matrix: build_and_test
Fit to window
Zoom out
Zoom in

Annotations

25 errors and 2 notices
build_and_test (22.x, ubuntu-latest)
Process completed with exit code 1.
build_and_test (20.x, ubuntu-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
build_and_test (20.x, ubuntu-latest)
Process completed with exit code 1.
build_and_test (22.x, windows-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
[firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
4) [firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode Error: expect(page).toHaveScreenshot(expected) 3757 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-whe-a1d5a--toggled-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3757 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3757 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:90:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 3652 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3652 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3652 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 3652 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3652 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3652 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected Error: expect(page).toHaveScreenshot(expected) 3652 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3652 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3652 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4022 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4022 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4022 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4022 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4022 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4022 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode Error: expect(page).toHaveScreenshot(expected) 4022 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4022 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4022 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4149 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4149 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4149 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4149 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4149 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4149 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected Error: expect(page).toHaveScreenshot(expected) 4149 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4149 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4149 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
build_and_test (20.x, windows-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
[firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
4) [firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode Error: expect(page).toHaveScreenshot(expected) 3757 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-whe-a1d5a--toggled-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3757 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3757 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:90:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 3652 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3652 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3652 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 3652 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3652 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3652 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected Error: expect(page).toHaveScreenshot(expected) 3652 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3652 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3652 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4022 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4022 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4022 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4022 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4022 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4022 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode: packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode Error: expect(page).toHaveScreenshot(expected) 4022 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4022 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4022 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4149 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4149 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4149 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(page).toHaveScreenshot(expected) 4149 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4149 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4149 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected: packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected Error: expect(page).toHaveScreenshot(expected) 4149 pixels (ratio 0.01 of all image pixels) are different. Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png Call log: - Expect "toHaveScreenshot" with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 4149 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 4149 pixels (ratio 0.01 of all image pixels) are different. at lib\helpers.ts:15 13 | if (isHeadless()) { 14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor(); > 15 | await expect(page).toHaveScreenshot(); | ^ 16 | } else { 17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode'); 18 | context.skip(); at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24) at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
🎭 Playwright Run Summary
17 failed [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected [firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode [firefox] › test\integration\drawer-test.it.spec.ts:22:3 › Drawer test view › should look as expected [firefox] › test\integration\drawer-test.it.spec.ts:28:3 › Drawer test view › should look as expected in dark mode [firefox] › test\integration\drawer-test.it.spec.ts:54:5 › Drawer test view › when "read more" is toggled › should look as expected [firefox] › test\integration\drawer-test.it.spec.ts:59:5 › Drawer test view › when "read more" is toggled › should look as expected in dark mode [firefox] › test\integration\lib\helpers.ts:7:3 › Test view › test file with code and test locations › when navigating "previous test" › should look as expected [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening a code file › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › and typing in the search box › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › should match the light theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening a code file › should match the light theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › should match the light theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › and typing in the search box › should match the light theme 5 flaky [chromium] › test\integration\navigation.it.spec.ts:30:7 › Navigation › when starting at the index page › -> "config" › should show "config" page [chromium] › test\integration\navigation.it.spec.ts:49:9 › Navigation › when starting at the index page › -> "config" › when navigating to "All files" using the breadcrumb › should show "all files" [chromium] › test\integration\navigation.it.spec.ts:94:9 › Navigation › when opening a report with test details › open tests › -> metrics › should show "metrics" page [chromium] › test\integration\navigation.it.spec.ts:113:11 › Navigation › when opening a report with test details › open tests › -> metrics › when navigating to "All tests" using the breadcrumb › should show "all tests" [chromium] › test\integration\real-time-reporting.it.spec.ts:48:5 › real-time reporting › when navigating to the overview page › should show a small progress-bar when scrolling down the page 158 passed (10.7m)
🎭 Playwright Run Summary
17 failed [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected [firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode [firefox] › test\integration\drawer-test.it.spec.ts:27:3 › Drawer test view › should look as expected [firefox] › test\integration\drawer-test.it.spec.ts:32:3 › Drawer test view › should look as expected in dark mode [firefox] › test\integration\drawer-test.it.spec.ts:62:5 › Drawer test view › when "read more" is toggled › should look as expected [firefox] › test\integration\drawer-test.it.spec.ts:66:5 › Drawer test view › when "read more" is toggled › should look as expected in dark mode [firefox] › test\integration\lib\helpers.ts:7:3 › Test view › test file with code and test locations › when navigating "previous test" › should look as expected [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening a code file › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › and typing in the search box › should match the dark theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › should match the light theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening a code file › should match the light theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › should match the light theme [firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › and typing in the search box › should match the light theme 5 flaky [chromium] › test\integration\navigation.it.spec.ts:30:7 › Navigation › when starting at the index page › -> "config" › should show "config" page [chromium] › test\integration\navigation.it.spec.ts:49:9 › Navigation › when starting at the index page › -> "config" › when navigating to "All files" using the breadcrumb › should show "all files" [chromium] › test\integration\navigation.it.spec.ts:94:9 › Navigation › when opening a report with test details › open tests › -> metrics › should show "metrics" page [chromium] › test\integration\navigation.it.spec.ts:113:11 › Navigation › when opening a report with test details › open tests › -> metrics › when navigating to "All tests" using the breadcrumb › should show "all tests" [chromium] › test\integration\real-time-reporting.it.spec.ts:48:5 › real-time reporting › when navigating to the overview page › should show a small progress-bar when scrolling down the page 158 passed (11.0m)

Artifacts

Produced during runtime
Name Size Digest
image-diffs
18.5 MB
sha256:159f483fd86a54f1e4165d6609c07535a3b678da1ab58a95d364a2602d3254b3