Unable to crawl heavy Javascript based website
Open
- Dominant language
- TypeScript
- Stars
- 12k
- Forks
- 882
- PR merge metrics
- No merged PRs in 30d
Description
Any tips on crawling below websites?
https://www.samsung.com/us/smartphones/galaxy-s25-ultra/compare/
https://www.apple.com/macbook-pro/compare/
So far, I'm only able to get gibberish content in the jina reader API response
Contributor guide
Research direction
Start by reproducing the jina reader API response for the Samsung Galaxy S25 Ultra comparison page and the Apple MacBook Pro comparison page. Inspect how the reader handles these JavaScript-heavy URLs; done means the returned content is readable and useful, or the limitation is clearly documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, typescript
- Domain
- backend, web-dev
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100