e2e tests fail locally - screenshot size incorrect
- Dominant language
- TypeScript
- Stars
- 38
- Forks
- 22
- PR merge metrics
- No merged PRs in 30d
Description
### Expected Behaviour
Tests should pass.
### Observed Behaviour
Tests fail with errors like:
```
Expected an image 1280px by 3128px, received 1280px by 3131px.
```
### Reproduction Steps
1. clone the repo
2. git clean -dfx && time (yarn && yarn build && TZ=America/Phoenix CI=true npx turbo run test --concurrency=1)
3. go afk for 5 minutes
### Screenshots or Videos
#### `chromium`
##### `full-page-expected.png`
##### `full-page-actual.png`
##### `full-page-diff.png`
#### `webkit`
##### `full-page-expected.png`
##### `full-page-actual.png`
##### `full-page-diff.png`
### Environment
- Browser version: `chromium`, `webkit`
- OS: ubuntu
- Web Forms version: `be1952cf5428bc2536ab81c45b8028111938b21b`
### Additional Context
Full test failure logs:
```
@getodk/web-forms:test: [test:e2e ] Running 78 tests using 1 worker
@getodk/web-forms:test: [test:e2e ] ·················×±····××F···················································××F
@getodk/web-forms:test: [test:e2e ] ···
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 1) [chromium] › e2e/test-cases/markdown.test.ts:16:2 › Markdown formatting › renders markdown styling
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(page).toHaveScreenshot(expected) failed
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Snapshot: full-page.png
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Call log:
@getodk/web-forms:test: [test:e2e ] - Expect "toHaveScreenshot(full-page.png)" with timeout 5000ms
@getodk/web-forms:test: [test:e2e ] - verifying given screenshot expectation
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ] - waiting 100ms before taking screenshot
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - captured a stable screenshot
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 30 | );
@getodk/web-forms:test: [test:e2e ] 31 |
@getodk/web-forms:test: [test:e2e ] > 32 | await expect(page).toHaveScreenshot('full-page.png', {
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 33 | fullPage: true,
@getodk/web-forms:test: [test:e2e ] 34 | maxDiffPixelRatio: 0.02,
@getodk/web-forms:test: [test:e2e ] 35 | });
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/markdown.test.ts:32:22
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #1: full-page (image/png) ───────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] Expected: e2e/test-cases/markdown.test.ts-snapshots/full-page-chromium.png
@getodk/web-forms:test: [test:e2e ] Received: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium/full-page-actual.png
@getodk/web-forms:test: [test:e2e ] Diff: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium/full-page-diff.png
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(page).toHaveScreenshot(expected) failed
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Snapshot: full-page.png
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Call log:
@getodk/web-forms:test: [test:e2e ] - Expect "toHaveScreenshot(full-page.png)" with timeout 5000ms
@getodk/web-forms:test: [test:e2e ] - verifying given screenshot expectation
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ] - waiting 100ms before taking screenshot
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - captured a stable screenshot
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 30 | );
@getodk/web-forms:test: [test:e2e ] 31 |
@getodk/web-forms:test: [test:e2e ] > 32 | await expect(page).toHaveScreenshot('full-page.png', {
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 33 | fullPage: true,
@getodk/web-forms:test: [test:e2e ] 34 | maxDiffPixelRatio: 0.02,
@getodk/web-forms:test: [test:e2e ] 35 | });
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/markdown.test.ts:32:22
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #1: full-page (image/png) ───────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] Expected: e2e/test-cases/markdown.test.ts-snapshots/full-page-chromium.png
@getodk/web-forms:test: [test:e2e ] Received: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry1/full-page-actual.png
@getodk/web-forms:test: [test:e2e ] Diff: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry1/full-page-diff.png
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry1/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #3: trace (application/zip) ─────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry1/trace.zip
@getodk/web-forms:test: [test:e2e ] Usage:
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] yarn playwright show-trace test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry1/trace.zip
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(page).toHaveScreenshot(expected) failed
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Snapshot: full-page.png
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Call log:
@getodk/web-forms:test: [test:e2e ] - Expect "toHaveScreenshot(full-page.png)" with timeout 5000ms
@getodk/web-forms:test: [test:e2e ] - verifying given screenshot expectation
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ] - waiting 100ms before taking screenshot
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - captured a stable screenshot
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3131px, received 1265px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 30 | );
@getodk/web-forms:test: [test:e2e ] 31 |
@getodk/web-forms:test: [test:e2e ] > 32 | await expect(page).toHaveScreenshot('full-page.png', {
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 33 | fullPage: true,
@getodk/web-forms:test: [test:e2e ] 34 | maxDiffPixelRatio: 0.02,
@getodk/web-forms:test: [test:e2e ] 35 | });
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/markdown.test.ts:32:22
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #1: full-page (image/png) ───────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] Expected: e2e/test-cases/markdown.test.ts-snapshots/full-page-chromium.png
@getodk/web-forms:test: [test:e2e ] Received: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry2/full-page-actual.png
@getodk/web-forms:test: [test:e2e ] Diff: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry2/full-page-diff.png
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-chromium-retry2/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 2) [webkit] › e2e/test-cases/markdown.test.ts:16:2 › Markdown formatting › renders markdown styling
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(page).toHaveScreenshot(expected) failed
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Snapshot: full-page.png
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Call log:
@getodk/web-forms:test: [test:e2e ] - Expect "toHaveScreenshot(full-page.png)" with timeout 5000ms
@getodk/web-forms:test: [test:e2e ] - verifying given screenshot expectation
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ] - waiting 100ms before taking screenshot
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - captured a stable screenshot
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 30 | );
@getodk/web-forms:test: [test:e2e ] 31 |
@getodk/web-forms:test: [test:e2e ] > 32 | await expect(page).toHaveScreenshot('full-page.png', {
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 33 | fullPage: true,
@getodk/web-forms:test: [test:e2e ] 34 | maxDiffPixelRatio: 0.02,
@getodk/web-forms:test: [test:e2e ] 35 | });
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/markdown.test.ts:32:22
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #1: full-page (image/png) ───────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] Expected: e2e/test-cases/markdown.test.ts-snapshots/full-page-webkit.png
@getodk/web-forms:test: [test:e2e ] Received: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit/full-page-actual.png
@getodk/web-forms:test: [test:e2e ] Diff: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit/full-page-diff.png
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(page).toHaveScreenshot(expected) failed
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Snapshot: full-page.png
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Call log:
@getodk/web-forms:test: [test:e2e ] - Expect "toHaveScreenshot(full-page.png)" with timeout 5000ms
@getodk/web-forms:test: [test:e2e ] - verifying given screenshot expectation
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ] - waiting 100ms before taking screenshot
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - captured a stable screenshot
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 30 | );
@getodk/web-forms:test: [test:e2e ] 31 |
@getodk/web-forms:test: [test:e2e ] > 32 | await expect(page).toHaveScreenshot('full-page.png', {
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 33 | fullPage: true,
@getodk/web-forms:test: [test:e2e ] 34 | maxDiffPixelRatio: 0.02,
@getodk/web-forms:test: [test:e2e ] 35 | });
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/markdown.test.ts:32:22
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #1: full-page (image/png) ───────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] Expected: e2e/test-cases/markdown.test.ts-snapshots/full-page-webkit.png
@getodk/web-forms:test: [test:e2e ] Received: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry1/full-page-actual.png
@getodk/web-forms:test: [test:e2e ] Diff: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry1/full-page-diff.png
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry1/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #3: trace (application/zip) ─────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry1/trace.zip
@getodk/web-forms:test: [test:e2e ] Usage:
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] yarn playwright show-trace test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry1/trace.zip
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(page).toHaveScreenshot(expected) failed
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Snapshot: full-page.png
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Call log:
@getodk/web-forms:test: [test:e2e ] - Expect "toHaveScreenshot(full-page.png)" with timeout 5000ms
@getodk/web-forms:test: [test:e2e ] - verifying given screenshot expectation
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ] - waiting 100ms before taking screenshot
@getodk/web-forms:test: [test:e2e ] - taking page screenshot
@getodk/web-forms:test: [test:e2e ] - disabled all CSS animations
@getodk/web-forms:test: [test:e2e ] - waiting for fonts to load...
@getodk/web-forms:test: [test:e2e ] - fonts loaded
@getodk/web-forms:test: [test:e2e ] - captured a stable screenshot
@getodk/web-forms:test: [test:e2e ] - Expected an image 1280px by 3128px, received 1280px by 3131px.
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 30 | );
@getodk/web-forms:test: [test:e2e ] 31 |
@getodk/web-forms:test: [test:e2e ] > 32 | await expect(page).toHaveScreenshot('full-page.png', {
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 33 | fullPage: true,
@getodk/web-forms:test: [test:e2e ] 34 | maxDiffPixelRatio: 0.02,
@getodk/web-forms:test: [test:e2e ] 35 | });
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/markdown.test.ts:32:22
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] attachment #1: full-page (image/png) ───────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ] Expected: e2e/test-cases/markdown.test.ts-snapshots/full-page-webkit.png
@getodk/web-forms:test: [test:e2e ] Received: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry2/full-page-actual.png
@getodk/web-forms:test: [test:e2e ] Diff: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry2/full-page-diff.png
@getodk/web-forms:test: [test:e2e ] ────────────────────────────────────────────────────────────────────────────────────────────────
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-markdown-Markdo-8411d-ng-renders-markdown-styling-webkit-retry2/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 3) [chromium] › e2e/test-cases/build/web-forms-preview-forms.test.ts:5:2 › Web Forms Preview Demo Forms › demo forms load
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error: expect(received).toBeGreaterThan(expected)
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Expected: > 0
@getodk/web-forms:test: [test:e2e ] Received: 0
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 9 | const formPreviewLinks = await page.locator('.form-preview-link').all();
@getodk/web-forms:test: [test:e2e ] 10 |
@getodk/web-forms:test: [test:e2e ] > 11 | expect(formPreviewLinks.length).toBeGreaterThan(0);
@getodk/web-forms:test: [test:e2e ] | ^
@getodk/web-forms:test: [test:e2e ] 12 |
@getodk/web-forms:test: [test:e2e ] 13 | for (const link of formPreviewLinks) {
@getodk/web-forms:test: [test:e2e ] 14 | const [formPreviewPage] = await Promise.all([context.waitForEvent('page'), link.click()]);
@getodk/web-forms:test: [test:e2e ] at webforms/packages/web-forms/e2e/test-cases/build/web-forms-preview-forms.test.ts:11:35
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] Error Context: test-results/test-cases-build-web-forms-b572b--Demo-Forms-demo-forms-load-chromium/error-context.md
@getodk/web-forms:test: [test:e2e ]
@getodk/web-forms:test: [test:e2e ] 2 failed
@getodk/web-forms:test: [test:e2e ] [chromium] › e2e/test-cases/markdown.test.ts:16:2 › Markdown formatting › renders markdown styling
@getodk/web-forms:test: [test:e2e ] [webkit] › e2e/test-cases/markdown.test.ts:16:2 › Markdown formatting › renders markdown styling
@getodk/web-forms:test: [test:e2e ] 1 flaky
@getodk/web-forms:test: [test:e2e ] [chromium] › e2e/test-cases/build/web-forms-preview-forms.test.ts:5:2 › Web Forms Preview Demo Forms › demo forms load
@getodk/web-forms:test: [test:e2e ] 75 passed (3.8m)
@getodk/web-forms:test: [test:e2e ] error Command failed with exit code 1.
@getodk/web-forms:test: [test:e2e ] info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
@getodk/web-forms:test: ERROR: "test:e2e" exited with 1.
```
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by running the provided clean-build command and inspect packages/web-forms/e2e/test-cases/markdown.test.ts, especially the screenshot assertion at line 32. Compare the expected snapshot in e2e/test-cases/markdown.test.ts-snapshots/full-page-chromium.png with the generated screenshots for Chromium and WebKit. Done means the affected end-to-end tests pass locally with consistent screenshot dimensions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- playwright, typescript
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100