chore(deps): update dependency @playwright/test to v1.53.0 #13567
ci.yml
on: pull_request
incremental_mutation_testing
1m 28s
Matrix: build_and_test
Annotations
25 errors and 2 notices
build_and_test (22.x, ubuntu-latest)
Process completed with exit code 1.
|
build_and_test (20.x, ubuntu-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
build_and_test (20.x, ubuntu-latest)
Process completed with exit code 1.
|
build_and_test (22.x, windows-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
4) [firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode
Error: expect(page).toHaveScreenshot(expected)
3757 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-whe-a1d5a--toggled-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3757 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3757 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:90:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
3652 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3652 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3652 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
3652 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3652 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3652 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
Error: expect(page).toHaveScreenshot(expected)
3652 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3652 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3652 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4022 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4022 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4022 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4022 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4022 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4022 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
Error: expect(page).toHaveScreenshot(expected)
4022 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4022 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4022 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4149 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4149 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4149 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4149 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4149 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4149 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
Error: expect(page).toHaveScreenshot(expected)
4149 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4149 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4149 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
|
build_and_test (20.x, windows-latest)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
4) [firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode
Error: expect(page).toHaveScreenshot(expected)
3757 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-whe-a1d5a--toggled-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-60a44-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--a1d5a--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3757 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3757 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:90:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
3652 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3652 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3652 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
3652 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3652 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3652 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
3) [firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
Error: expect(page).toHaveScreenshot(expected)
3652 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-when-read-more-is-toggled-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-336fc-led-should-look-as-expected-firefox\Drawer-mutant-view-when-a--51707-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 3652 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 3652 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:85:9
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4022 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry2\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4022 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4022 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4022 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox-retry1\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4022 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4022 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode:
packages\elements\test\integration\lib\helpers.ts#L15
2) [firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
Error: expect(page).toHaveScreenshot(expected)
4022 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-in-dark-mode-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-4cebe-ok-as-expected-in-dark-mode-firefox\Drawer-mutant-view-when-a--7d9e1--as-expected-in-dark-mode-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4022 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4022 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:39:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4149 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry2\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4149 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4149 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(page).toHaveScreenshot(expected)
4149 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox-retry1\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4149 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4149 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
|
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected:
packages\elements\test\integration\lib\helpers.ts#L15
1) [firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
Error: expect(page).toHaveScreenshot(expected)
4149 pixels (ratio 0.01 of all image pixels) are different.
Expected: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts-snapshots\Drawer-mutant-view-when-a-mutant-is-opened-should-look-as-expected-1-firefox-win32.png
Received: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-actual.png
Diff: D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test-results\drawer-mutant.it-Drawer-mu-ca505-ned-should-look-as-expected-firefox\Drawer-mutant-view-when-a--00f72-d-should-look-as-expected-1-diff.png
Call log:
- Expect "toHaveScreenshot" with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 4149 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 4149 pixels (ratio 0.01 of all image pixels) are different.
at lib\helpers.ts:15
13 | if (isHeadless()) {
14 | await page.locator('mutation-test-report-app >> :is(mte-test-view, mte-mutant-view)').waitFor();
> 15 | await expect(page).toHaveScreenshot();
| ^
16 | } else {
17 | console.log('[SKIP] skipping screenshot comparison, because not running in headless mode');
18 | context.skip();
at actScreenshotMatch (D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\lib\helpers.ts:15:24)
at D:\a\mutation-testing-elements\mutation-testing-elements\packages\elements\test\integration\drawer-mutant.it.spec.ts:33:7
|
🎭 Playwright Run Summary
17 failed
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
[firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode
[firefox] › test\integration\drawer-test.it.spec.ts:22:3 › Drawer test view › should look as expected
[firefox] › test\integration\drawer-test.it.spec.ts:28:3 › Drawer test view › should look as expected in dark mode
[firefox] › test\integration\drawer-test.it.spec.ts:54:5 › Drawer test view › when "read more" is toggled › should look as expected
[firefox] › test\integration\drawer-test.it.spec.ts:59:5 › Drawer test view › when "read more" is toggled › should look as expected in dark mode
[firefox] › test\integration\lib\helpers.ts:7:3 › Test view › test file with code and test locations › when navigating "previous test" › should look as expected
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening a code file › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › and typing in the search box › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › should match the light theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening a code file › should match the light theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › should match the light theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › and typing in the search box › should match the light theme
5 flaky
[chromium] › test\integration\navigation.it.spec.ts:30:7 › Navigation › when starting at the index page › -> "config" › should show "config" page
[chromium] › test\integration\navigation.it.spec.ts:49:9 › Navigation › when starting at the index page › -> "config" › when navigating to "All files" using the breadcrumb › should show "all files"
[chromium] › test\integration\navigation.it.spec.ts:94:9 › Navigation › when opening a report with test details › open tests › -> metrics › should show "metrics" page
[chromium] › test\integration\navigation.it.spec.ts:113:11 › Navigation › when opening a report with test details › open tests › -> metrics › when navigating to "All tests" using the breadcrumb › should show "all tests"
[chromium] › test\integration\real-time-reporting.it.spec.ts:48:5 › real-time reporting › when navigating to the overview page › should show a small progress-bar when scrolling down the page
158 passed (10.7m)
|
🎭 Playwright Run Summary
17 failed
[firefox] › test\integration\drawer-mutant.it.spec.ts:31:5 › Drawer mutant view › when a mutant is opened › should look as expected
[firefox] › test\integration\drawer-mutant.it.spec.ts:36:5 › Drawer mutant view › when a mutant is opened › should look as expected in dark mode
[firefox] › test\integration\drawer-mutant.it.spec.ts:84:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected
[firefox] › test\integration\drawer-mutant.it.spec.ts:88:7 › Drawer mutant view › when a mutant is opened › when "read more" is toggled › should look as expected in dark mode
[firefox] › test\integration\drawer-test.it.spec.ts:27:3 › Drawer test view › should look as expected
[firefox] › test\integration\drawer-test.it.spec.ts:32:3 › Drawer test view › should look as expected in dark mode
[firefox] › test\integration\drawer-test.it.spec.ts:62:5 › Drawer test view › when "read more" is toggled › should look as expected
[firefox] › test\integration\drawer-test.it.spec.ts:66:5 › Drawer test view › when "read more" is toggled › should look as expected in dark mode
[firefox] › test\integration\lib\helpers.ts:7:3 › Test view › test file with code and test locations › when navigating "previous test" › should look as expected
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening a code file › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › dark theme › when opening the file picker › and typing in the search box › should match the dark theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › should match the light theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening a code file › should match the light theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › should match the light theme
[firefox] › test\integration\lib\helpers.ts:7:3 › Theming › light theme › when opening the file picker › and typing in the search box › should match the light theme
5 flaky
[chromium] › test\integration\navigation.it.spec.ts:30:7 › Navigation › when starting at the index page › -> "config" › should show "config" page
[chromium] › test\integration\navigation.it.spec.ts:49:9 › Navigation › when starting at the index page › -> "config" › when navigating to "All files" using the breadcrumb › should show "all files"
[chromium] › test\integration\navigation.it.spec.ts:94:9 › Navigation › when opening a report with test details › open tests › -> metrics › should show "metrics" page
[chromium] › test\integration\navigation.it.spec.ts:113:11 › Navigation › when opening a report with test details › open tests › -> metrics › when navigating to "All tests" using the breadcrumb › should show "all tests"
[chromium] › test\integration\real-time-reporting.it.spec.ts:48:5 › real-time reporting › when navigating to the overview page › should show a small progress-bar when scrolling down the page
158 passed (11.0m)
|
Artifacts
Produced during runtime
Name | Size | Digest | |
---|---|---|---|
image-diffs
|
18.5 MB |
sha256:159f483fd86a54f1e4165d6609c07535a3b678da1ab58a95d364a2602d3254b3
|
|