josharsh / josharsh/pixelpi

Vision fallback (Set-of-Marks) for canvas / poor-markup pages

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
19
Forks
3
PR merge metrics
No merged PRs in 30d

Description

`look()` is a11y-tree-first, which is right ~90% of the time but returns near-empty on canvas-heavy or poorly-marked-up pages.

**Task:** when the a11y tree is sparse, fall back to a screenshot with numbered Set-of-Marks overlays so elements are still addressable by stable integer ref (never raw coordinates). `look({ mode: "screenshot" })` already exists as the seam.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.