Skip to content

End to End Tests

End to End Tests #6843

Triggered via merge group April 11, 2025 14:27
Status Success
Total duration 12m 59s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
2m 14s
Build Element-Web
Matrix: playwright
end-to-end-tests
47s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

5 errors and 6 notices
[Chrome] › playwright/e2e/room/invites.spec.ts:18:9 › Invites › should render an invite view @screenshot: playwright/e2e/room/invites.spec.ts#L22
1) [Chrome] › playwright/e2e/room/invites.spec.ts:18:9 › Invites › should render an invite view @screenshot Error: expect(locator).toHaveScreenshot(expected) 731 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/room/invites.spec.ts/Invites-room-view-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/room-invites-Invites-should-render-an-invite-view-Chrome/Invites-room-view-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/room-invites-Invites-should-render-an-invite-view-Chrome/Invites-room-view-diff.png Call log: - expect.toHaveScreenshot(Invites-room-view.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_RoomView') - locator resolved to <div class="mx_RoomView">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 731 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_RoomView') - locator resolved to <div class="mx_RoomView">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 731 pixels (ratio 0.01 of all image pixels) are different. 20 | await bot.inviteUser(roomId, user.userId); 21 | await app.viewRoomByName("Bob"); > 22 | await expect(page.locator(".mx_RoomView")).toMatchScreenshot("Invites_room_view.png"); | ^ 23 | }); 24 | 25 | test("should be able to decline an invite", async ({ page, homeserver, user, bot, app }) => { at /home/runner/work/element-web/element-web/playwright/e2e/room/invites.spec.ts:22:52
[Chrome] › playwright/e2e/timeline/timeline.spec.ts:1024:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot: playwright/e2e/timeline/timeline.spec.ts#L1107
1) [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1024:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot Error: expect(locator).toHaveScreenshot(expected) 41 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tile-reply-chains-irc-modern-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-801c1-hould-display-a-reply-chain-Chrome/event-tile-reply-chains-irc-modern-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-801c1-hould-display-a-reply-chain-Chrome/event-tile-reply-chains-irc-modern-diff.png Call log: - expect.toHaveScreenshot(event-tile-reply-chains-irc-modern.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$nfKGbgqTfuWQgV9ySpaGpHhBrwyDvk7l8V3bm_3yJD0" data-scroll-tokens="$nfKGbgqTfuWQgV9ySpaGpHhBrwyDvk7l8V3bm_3yJD0" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 29 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$nfKGbgqTfuWQgV9ySpaGpHhBrwyDvk7l8V3bm_3yJD0" data-scroll-tokens="$nfKGbgqTfuWQgV9ySpaGpHhBrwyDvk7l8V3bm_3yJD0" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 12 pixels (ratio 0.01 of all image pixels) are different. - waiting 250ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="true" data-event-id="$nfKGbgqTfuWQgV9ySpaGpHhBrwyDvk7l8V3bm_3yJD0" data-scroll-tokens="$nfKGbgqTfuWQgV9ySpaGpHhBrwyDvk7l8V3bm_3yJD0" class="mx_EventTile mx_EventTile_continuation mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 41 pixels (ratio 0.01 of all image pixels) are different. 1105 | 1106 | // Take a snapshot on modern layout > 1107 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot( | ^ 1108 | "event-tile-reply-chains-irc-modern.png", 1109 | screenshotOptions, 1110 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:1107:62
[Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot: playwright/e2e/audio-player/audio-player.spec.ts#L21
1) [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot Error: Test timeout of 30000ms exceeded 19 | await tile.hover(); 20 | await tile.getByRole("button", { name: "Reply", exact: true }).click(); > 21 | }).toPass(); | ^ 22 | }; 23 | 24 | test.describe("Audio player", { tag: ["@no-firefox", "@no-webkit"] }, () => { at clickButtonReply (/home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:21:8) at /home/runner/work/element-web/element-web/playwright/e2e/audio-player/audio-player.spec.ts:274:19
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L96
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: "route.fetch: Test ended." while running route callback. Consider awaiting `await page.unrouteAll({ behavior: 'ignoreErrors' })` before the end of the test to ignore remaining routes in flight. 94 | await route.fulfill({ json: {} }); 95 | await new Promise((f) => setTimeout(f, 1000)); > 96 | await route.fetch(); | ^ 97 | }); 98 | 99 | await logIntoElement(page, credentials); at /home/runner/work/element-web/element-web/playwright/e2e/crypto/device-verification.spec.ts:96:25
[Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit: playwright/e2e/crypto/device-verification.spec.ts#L1
2) [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit Error: apiRequestContext.fetch: Target page, context or browser has been closed Call log: - → POST http://localhost:45709/_synapse/admin/v1/register - user-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.6998.35 Safari/537.36 - accept: */* - accept-encoding: gzip,deflate,br - content-type: application/json - content-length: 310 at Api.request (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/utils/api.js:28:41) at StartedSynapseContainer.registerUserInternal (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/testcontainers/synapse.js:287:42) at Object.credentials (/home/runner/work/element-web/element-web/node_modules/@element-hq/element-web-playwright-common/lib/fixtures/user.js:16:29)
🎭 Playwright Run Summary
2 skipped 81 passed (6.4m)
🎭 Playwright Run Summary
43 skipped 47 passed (6.3m)
🎭 Playwright Run Summary
2 skipped 90 passed (7.5m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/room/invites.spec.ts:18:9 › Invites › should render an invite view @screenshot 2 skipped 85 passed (7.4m)
🎭 Playwright Run Summary
1 flaky [Chrome] › playwright/e2e/timeline/timeline.spec.ts:1024:13 › Timeline › message sending › should display a reply chain @no-firefox @no-webkit @screenshot 76 passed (8.3m)
🎭 Playwright Run Summary
2 flaky [Chrome] › playwright/e2e/audio-player/audio-player.spec.ts:250:9 › Audio player › should support creating a reply chain with multiple audio files @no-firefox @no-webkit @screenshot [Chrome] › playwright/e2e/crypto/device-verification.spec.ts:121:9 › Device verification › Verify device with QR code during login @no-webkit 89 passed (8.1m)

Artifacts

Produced during runtime
Name Size Digest
all-blob-reports-Chrome-1 Expired
11.4 MB
sha256:8ca39bbac014775977cf616783b1f346c917fc4b392b93a7e145f1e3d1f235e1
all-blob-reports-Chrome-2 Expired
308 KB
sha256:84591d8b6d865ad42315faa403ea2d0b11631349e1c08c96906b8537f27f2237
all-blob-reports-Chrome-3 Expired
277 KB
sha256:bb0c33f9bad28e909615969dc77f0dcfd558735a403bbd02b942d3fc61ab46a9
all-blob-reports-Chrome-4 Expired
3.19 MB
sha256:5bd6610120f792e48ac1b2d857fe3b81e3c5045ceb048ce64f2ad8b7c47c3f29
all-blob-reports-Chrome-5 Expired
546 KB
sha256:c31d6d4723ffdcd699375d5cf06a7b10868476fa52a52876b25d1340bbe66798
all-blob-reports-Chrome-6 Expired
5.22 MB
sha256:8c4e02f0dbffd1fa5ce7f14ae7ab66b23e17f8fea31df7116c35f5d89581113f
html-report Expired
19.6 MB
sha256:1af40d3731c5e30f277d03894fda5e3b3260c7255d925d3ae01cc3e4a9c0aa66
webapp Expired
34.9 MB
sha256:6c19fa57b9c5ea112edd69e02cb701f27a8ac2562b03ba7715cad97646c71d66