pytest-dev / pytest-dev/pytest-html

pytest-html 4 performance regression

Open
#684 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
779
Forks
260
PR merge metrics
No merged PRs in 30d

Description

My test suite contains ~4k tests (heavy parametrization) with logs and sometimes screenshots.

The report generated by the latest stable version of pytest-html opens much faster than the report generated by 4.0.0rc4

Report generated with pytest 3.2.0 loads in 5-10 sec
Report generated with 4.0.0rc4 takes about 40 sec

Firefox 114.0, Linux

Similar difference when you change sorting order, etc.

3.2.0 report: fast.zip
4.0.0rc4 report: slow.zip

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the comparison using the attached fast.zip and slow.zip reports, focusing on a roughly 4,000-test parametrized suite with logs and screenshots. Compare pytest-html 3.2.0 with 4.0.0rc4 in Firefox on Linux; done means report loading and sorting return near the earlier performance rather than taking about 40 seconds.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
performance, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.