matthewmueller/x-ray

View on GitHub

The next web scraper. See through the <html> noise.

Stars: 5.9k
Forks: 342
Open beginner issues: 0
Indexed issues: 63

Dominant language: JavaScript
License: MIT
Last GitHub push: Aug 12, 2020
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

63 open issues indexed

Is getting scoped tag name possible ? Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#389 · Opened Aug 10, 2022
Want to capture the "div" which is created after scrolling the page Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

matthewmueller/x-ray#383 · 1 comment · Opened Feb 15, 2022
li works but div is not Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

matthewmueller/x-ray#382 · Opened Feb 10, 2022
DeprecationWarning: OutgoingMessage.prototype._headers is deprecated Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#381 · 3 reactions · Opened Feb 9, 2022
Dependency Dashboard Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

matthewmueller/x-ray#379 · Opened Oct 19, 2021
Bug report - img@src fails but alt works Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#373 · Opened Mar 13, 2021
Does filtering return JSON support? Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#369 · 1 comment · Opened Sep 18, 2020
ERR_STREAM_WRITE_AFTER_END when using async/await Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#366 · 1 comment · 1 reaction · Opened Jun 2, 2020
filter only selected words? Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#361 · Opened Oct 27, 2019
For Loop Only Crawls First Link Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#360 · 1 comment · Opened Oct 24, 2019
Set a local timeout Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

matthewmueller/x-ray#359 · Opened Oct 18, 2019
Update Examples Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#358 · 2 reactions · Opened Oct 18, 2019
selecting items and handle them sequentially Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

matthewmueller/x-ray#349 · 4 comments · Opened Jul 13, 2019
Documentation improvement project(?) Open

enhancement

matthewmueller/x-ray#334 · 1 comment · 6 reactions · 1 assignee · Opened Apr 18, 2019
Update to ES6+ / Node v6+ Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

matthewmueller/x-ray#315 · 6 comments · 1 reaction · Opened Jul 10, 2018
PhantomJS no longer being maintained, switch to chrome headless instead Open

feature ready for contributor

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matthewmueller/x-ray#304 · 2 comments · 12 reactions · Opened Mar 4, 2018
Conditional redirect? Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#280 · 2 comments · Opened Dec 30, 2017
Looking for maintainers Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

matthewmueller/x-ray#252 · 11 comments · 3 reactions · Opened Feb 24, 2017
Question with "paginate" buttons that don't have the href link in them Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 25/100

matthewmueller/x-ray#242 · 1 reaction · Opened Jan 6, 2017
Crawling multiple URL from a collection Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#212 · 2 comments · 1 reaction · Opened Sep 21, 2016
Starts with attribute selector doesn't work: [attribute^=value] Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

matthewmueller/x-ray#210 · Opened Sep 3, 2016
3.0.0: Move to using GraphQL Open

feature

Difficulty 5/5 Over a week Newbie friendliness 20/100

matthewmueller/x-ray#208 · 7 comments · 2 reactions · Opened Aug 31, 2016
Internationalized pages being scraped with wrong locale. Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

matthewmueller/x-ray#207 · 2 comments · Opened Aug 19, 2016
Function name typo in examples Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

matthewmueller/x-ray#206 · Opened Aug 18, 2016
Direct Child after body Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#205 · Opened Aug 10, 2016
Errors get swallowed when nested selectors are used Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

matthewmueller/x-ray#203 · 3 comments · 1 reaction · Opened Aug 3, 2016
Filter receives value '' as empty string when it is supposed to be undefined Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

matthewmueller/x-ray#202 · 2 reactions · Opened Jul 24, 2016
Improve communication with driver Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

matthewmueller/x-ray#197 · 1 comment · Opened Jul 12, 2016
Crawling to another site on collection always undefined Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#189 · 19 comments · 4 reactions · Opened Jun 10, 2016
useragent support? Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#188 · 2 comments · Opened May 30, 2016
Unable to resolve _http_common (on meteor) Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matthewmueller/x-ray#187 · 9 comments · 2 reactions · Opened May 27, 2016
Getting and Submitting a form Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

matthewmueller/x-ray#185 · 1 comment · Opened May 26, 2016
How can i change the encoding? Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#183 · 8 comments · 4 reactions · Opened May 21, 2016
Change request headers dynamically Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matthewmueller/x-ray#182 · Opened May 21, 2016
Hook for before-next-page? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matthewmueller/x-ray#172 · Opened Apr 14, 2016
Uncaught ECONNRESET exception Open

bug help wanted

Difficulty 3/5 1-2 days Newbie friendliness 25/100

matthewmueller/x-ray#171 · 1 comment · Opened Apr 9, 2016
User Agent String Support Open

help wanted question

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matthewmueller/x-ray#168 · 19 comments · 9 reactions · Opened Apr 6, 2016
Better Stream Support Open

enhancement epic help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

matthewmueller/x-ray#160 · 2 reactions · Opened Mar 26, 2016
Decode XML/HTML entities Open

feature question ready for contributor

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#144 · 6 comments · Opened Mar 14, 2016
Issue with composition (crawling another page) + collection Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

matthewmueller/x-ray#135 · 6 comments · Opened Feb 8, 2016
Append data to file Open

feature ready for contributor

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#127 · 1 comment · Opened Jan 6, 2016
Cannot Read property 'html' of null Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

matthewmueller/x-ray#125 · 1 comment · Opened Jan 4, 2016
Feature request: retry Open

feature help wanted

Difficulty 4/5 3-5 days Newbie friendliness 30/100

matthewmueller/x-ray#94 · 7 comments · 7 reactions · Opened Sep 17, 2015
Can't catch an error thrown when there's an invalid status code 522 Open

bug help wanted

Difficulty 3/5 1-2 days Newbie friendliness 25/100

matthewmueller/x-ray#90 · 1 comment · 1 reaction · Opened Sep 2, 2015
callback errors are caught Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#87 · 1 comment · Opened Aug 27, 2015
Better error catching and recovery Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

matthewmueller/x-ray#84 · 2 comments · Opened Aug 18, 2015
More documented examples please.. e.g. How to adjust the User-Agent? Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#82 · 3 reactions · Opened Aug 13, 2015
Selector in paginate not run with ~ Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matthewmueller/x-ray#80 · Opened Aug 10, 2015
Array Crawling Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

matthewmueller/x-ray#79 · Opened Aug 7, 2015
Repo Relationships Open

docs

Difficulty 3/5 1-2 days Newbie friendliness 25/100

matthewmueller/x-ray#78 · Opened Jul 28, 2015

matthewmueller/x-ray

Get new issues in your inbox