mdn / mdn/fred

Run e2e tests across Chrome and Safari

Open
#1,437 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
JavaScript
Stars
233
Forks
61
Avg merge
1d 1h
Merged PRs (30d)
82

Description

For a test like https://github.com/mdn/fred/pull/1435 we ought to run cross-browser cross-OS, as text and scrollbars can and will render differently in those combinations.

We already run the npm simulation tests cross OS, but only in Firefox.

Our tests seem to fail locally for me in Chromium, due to some small differences in the playground copy test.

Our tests also will only run locally for me if I manually specify the path to my local Chromium binary. If I let wdio auto-download one, the tests seem to hang or never start.

Perhaps we don't need to run all tests cross-os cross-browser? Windows seems like a particularly slow path. But perhaps we go for coverage now, and optimize later.

We should also consider what versions to run against. Latest would be natural, but perhaps we should also run against the oldest versions in the Baseline browser set to ensure we don't break things there - we're least likely to test against those browsers after all.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting the existing npm simulation tests, the wdio setup, and the playground copy test that fails in Chromium. Run the current e2e tests in Chromium and review how Firefox is run across operating systems. Done means an agreed browser/OS/version matrix runs reliably, including Chrome and Safari, without the current startup or rendering failures.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
testing-qa, web-dev
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.