bamlab / bamlab/flashlight

Ability to measure custom spans/metrics

Open
#335 0 comments 0 reactions 0 assignees View on GitHub
Package:CLI Package:Front-End
Dominant language
TypeScript
Stars
1.6k
Forks
48
PR merge metrics
No merged PRs in 30d

Description

It would be useful if one could use the flashlight api during e2e tests (or some other way) to measure custom spans like TTID (time to initial display), TTFD (time to full display) of screens or tabs or just general operations that span multiple renders like a "how long does it take for dialog x to show up when I click button y". These would fit perfectly with flashlights repeated execution model to normalize the measures.

I"m not sure if Maestro allows timing such things (unfortunately), but maybe other e2e frameworks could (like Detox). An example user flow could be:

- Open app
- Goto tab A, wait for content to load
- Goto tab B, wait for content to load

In this flow we could have 4 metrics, 2 for each tab:
- "navigation time" or TTID: starting the span when the test touches the tab bar button for the respective tab, and ends when the test sees the first rendered frame/content on the respective tab content screen
- TTFD: same start as TTID, but ends when the test sees some final content visible in the respective tab content

Would this be possible/fit into the scope of flashlight?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.