meilisearch/scrapix

View on GitHub

Stars: 32
Forks: 9
Open beginner issues: 0
Indexed issues: 39

Dominant language: TypeScript
License: MIT
Last GitHub push: Jan 19, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

39 open issues indexed

Support embedding for semantic search Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

meilisearch/scrapix#123 · 1 comment · Opened Jul 27, 2025
NodeJS `ENAMETOOLONG` when mass crawling Open

meilisearch/scrapix#115 · 2 comments · 1 assignee · Opened Feb 11, 2025
By default use cheerio instead of Puppeteer Open

breaking-change enhancement

meilisearch/scrapix#113 · 1 assignee · Opened Nov 9, 2024
Remove the useless headless option Open

breaking-change enhancement

meilisearch/scrapix#112 · 1 assignee · Opened Nov 9, 2024
Scrapix V2 Open

epic

meilisearch/scrapix#111 · 1 assignee · Opened Nov 9, 2024
Create Markdown scraping strategy Open

enhancement

meilisearch/scrapix#110 · 1 assignee · Opened Nov 9, 2024
Create Cheerio crawling backend option Open

enhancement

meilisearch/scrapix#109 · 1 assignee · Opened Nov 9, 2024
Create Puppeteer crawling backend option Open

enhancement

meilisearch/scrapix#108 · 1 assignee · Opened Nov 9, 2024
Create Playwright crawling backend option Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

meilisearch/scrapix#107 · Opened Nov 9, 2024
Update Schema scraping strategy to handle microdata Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

meilisearch/scrapix#106 · Opened Nov 9, 2024
Detect/handle localized pages Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

meilisearch/scrapix#105 · Opened Nov 9, 2024
Index the PDF files Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

meilisearch/scrapix#104 · Opened Nov 9, 2024
Keep the previous settings Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

meilisearch/scrapix#103 · Opened Nov 9, 2024
Load the sitemap as starter point for crawling. Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

meilisearch/scrapix#102 · Opened Nov 9, 2024
Provide option to slow or rate limit requests Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

meilisearch/scrapix#99 · 1 comment · Opened May 10, 2024
Cannot run under Windows (path contains invalid characters) Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 30/100

meilisearch/scrapix#98 · 1 comment · Opened May 9, 2024
Scrapix Docker image configuration: JSON string parsing and Liquid syntax compatibility Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

meilisearch/scrapix#95 · Opened Feb 20, 2024
`user_agents` in configuration file doesn't change HTTP User-Agent header Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

meilisearch/scrapix#94 · Opened Feb 15, 2024
Add possibility to exclude selectors Open

enhancement

meilisearch/scrapix#93 · 1 reaction · 1 assignee · Opened Jan 23, 2024
Document the purpose of hierarchy_radio_lvl Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

meilisearch/scrapix#90 · Opened Jan 18, 2024
fix(crawler): fix `failed` webhook Open

cloudboard

Difficulty 4/5 3-5 days Newbie friendliness 25/100

meilisearch/scrapix#80 · 2 comments · Opened Aug 22, 2023
Throw error when redis server is not answering Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

meilisearch/scrapix#56 · Opened Jul 3, 2023
Retrieve page titles from meta tags Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

meilisearch/scrapix#53 · 3 comments · Opened Jun 29, 2023
Ensure same documents are not pushed more than once. Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 32/100

meilisearch/scrapix#52 · 2 comments · 1 reaction · Opened Jun 29, 2023
url_to_index does not work Open

bug needs more info

Difficulty 3/5 1-2 days Newbie friendliness 25/100

meilisearch/scrapix#49 · 1 comment · Opened Jun 28, 2023
Handle pages not found Open

bug enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

meilisearch/scrapix#48 · Opened Jun 28, 2023
Find out which field in the config files are mandatory or not Open

enhancement

meilisearch/scrapix#35 · 1 assignee · Opened Jun 21, 2023
Improve errors logs Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

meilisearch/scrapix#34 · Opened Jun 21, 2023
Add route to empty the task queue Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

meilisearch/scrapix#33 · 1 comment · Opened Jun 21, 2023
Where is `only_type` located in the schema settings option Open

question

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

meilisearch/scrapix#30 · 1 comment · Opened Jun 21, 2023
Update the name of the tool Open

maintenance

Difficulty 5/5 Over a week Newbie friendliness 25/100

meilisearch/scrapix#26 · 3 comments · Opened Jun 20, 2023
Adding a dependabot file Open

maintenance

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

meilisearch/scrapix#25 · Opened Jun 20, 2023
Create CONTRIBUTING.md Open

maintenance

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

meilisearch/scrapix#22 · Opened Jun 20, 2023
Improvement the README Open

maintenance

Difficulty 5/5 Over a week Newbie friendliness 25/100

meilisearch/scrapix#21 · 1 reaction · Opened Jun 20, 2023
Create custom scraper Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

meilisearch/scrapix#18 · 1 reaction · Opened Jun 20, 2023
Add basic tests Open

maintenance

Difficulty 5/5 Over a week Newbie friendliness 25/100

meilisearch/scrapix#16 · Opened Jun 19, 2023
Prepare scrapix for production use Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 15/100

meilisearch/scrapix#14 · Opened Jun 19, 2023
Being able to follow the crawling process Open

enhancement

meilisearch/scrapix#5 · 3 comments · 1 assignee · Opened Feb 14, 2023
Create a console for starting the crawling Open

enhancement

meilisearch/scrapix#4 · 1 assignee · Opened Feb 14, 2023

meilisearch/scrapix

Get new issues in your inbox