Inconsistent snapshots in `test-e2e-release` due to partially loaded scenes
- Dominant language
- JavaScript
- Stars
- 15.8k
- Forks
- 3.9k
- Avg merge
- 4d 6h
- Merged PRs (30d)
- 34
Description
### What happened?
In the release process running the Playwright tests with `npm run test-e2e-release` produces false positive errors because elements in the scene are at slightly different states in the loading process.
Examples:
It appears the scene has not changed but snapshots were taken at slightly different states in the loading process.
More consistent criteria for taking snapshots could also reduce false positive errors in other cases, eg. animation, particle systems
Contributor guide
Research direction
Start by running the Playwright suite with `npm run test-e2e-release` and inspect how its snapshots are taken while scenes load. Compare the reported inconsistent results, including animation and particle-system cases, and define a consistent snapshot criterion that eliminates false positives; done means the release tests produce stable snapshots.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, playwright
- Domain
- testing
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100