Comfy-Org / Comfy-Org/ComfyUI_frontend

Playwright Test analytics

Open
#12,724 0 comments 0 reactions 0 assignees View on GitHub
area:CI/CD
Dominant language
TypeScript
Stars
2k
Forks
699
Avg merge
1d 7h
Merged PRs (30d)
490

Description

Hi folks,

My name is Andrey, I'm a former Microsoft Playwright engineer.

I've noticed you're using Playwright Test and you even run [multiple shards](https://github.com/Comfy-Org/ComfyUI_frontend/actions/runs/27175867268/job/80226239104). I'd like to bring up the Flakiness.io project that we're building now to help track, fix & optimize tests: https://flakiness.io.

We just launched a new feature for Playwright Test - [balanced shards](https://github.com/flakiness/playwright#balanced-sharding). It should minimize the *makespan* of your sharded runs, so you'll get final results faster. I'd curious to see how it works on your workload.

In addition, you'll have all your tests in one place, on a single dashboard, with a performance, results & traces, for example https://flakiness.io/flakiness/pytest-flakiness.

Flakiness.io has a free plan for open source projects.

Let me know if you're interested - I'd be happy to help integrating and collecting the feedback.

Contributor guide

Open the contributing guide

Research direction

The issue names Playwright Test, sharded GitHub Actions runs, and Flakiness.io, but mentions no repository files, tests, or entry points. First determine whether the project wants this external integration; the scope, implementation location, and definition of done are not specified.

Written by the indexing model from the issue text.

Assessment

Tech stack
playwright, typescript
Domain
ci-cd, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.