leopardslab/CrawlerX

View on GitHub

CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.

Stars: 25
Forks: 19
Open beginner issues: 0
Indexed issues: 16

Dominant language: SCSS
License: Apache-2.0
Last GitHub push: Sep 4, 2022
Latest indexed: Sep 18, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: hacktoberfest
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

16 open issues indexed

Cannot build docker - Failed to build Twisted Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

leopardslab/CrawlerX#184 · 1 reaction · Opened May 10, 2023
[GSoC 2021] Integrate Django Celery Beat to manage and schedule Crawler jobs Open

gsoc2021

Difficulty 5/5 Over a week Newbie friendliness 15/100

leopardslab/CrawlerX#118 · Opened Jul 14, 2021
[Epic for GSoC 2021] Complete Improvements of CrawlerX web application Open

gsoc2021

leopardslab/CrawlerX#106 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] Documentation the progress of the project Open

gsoc2021

leopardslab/CrawlerX#105 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] Integrate user based data management module Open

gsoc2021

leopardslab/CrawlerX#104 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] Data export module for CrawlerX projects Open

gsoc2021

leopardslab/CrawlerX#103 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] Integrate Apache Airflow to manage Crawler jobs Open

gsoc2021

leopardslab/CrawlerX#102 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] Enable tor web URL support for CrawlerX Open

gsoc2021

leopardslab/CrawlerX#101 · 1 assignee · Opened Jun 5, 2021
[Epic for GSoC 2021] Complete CrawlerX Kubernetes Deployment with Helm Open

gsoc2021

leopardslab/CrawlerX#100 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] Update Readme.md file with the progress Open

gsoc2021

leopardslab/CrawlerX#99 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] K8s artifacts for apache Airflow server Open

gsoc2021

leopardslab/CrawlerX#98 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] K8s artifacts for ElasticSearch server and dashboard Open

gsoc2021

leopardslab/CrawlerX#97 · 1 assignee · Opened Jun 5, 2021
[GSoC 2021] K8s artifacts for MongoDB server Open

gsoc2021

leopardslab/CrawlerX#96 · 1 assignee · Opened Jun 5, 2021
Feature: Add Kubernetes artifacts for the CrawlerX project Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

leopardslab/CrawlerX#82 · 1 comment · Opened Apr 7, 2021
Feature: Add some new crawlers for popular web pages Open

Hacktoberfest

Difficulty 5/5 Over a week Newbie friendliness 30/100

leopardslab/CrawlerX#41 · 1 comment · Opened Oct 5, 2020
Feature: Improve Schedule new Job popup view Open

Hacktoberfest

Difficulty 4/5 3-5 days Newbie friendliness 35/100

leopardslab/CrawlerX#40 · 3 comments · Opened Oct 5, 2020

leopardslab/CrawlerX

Get new issues in your inbox