crawlab-team/crawlab
View on GitHubDistributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
- Stars
- 12.3k
- Forks
- 1.9k
- Open beginner issues
- 0
- Indexed issues
- 162
- Dominant language
- Go
- License
- BSD-3-Clause
- Last GitHub push
- Oct 9, 2024
- Latest indexed
- Sep 15, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
- PR merge metrics
- No merged PRs in 30d
-
enhancement v0.6
crawlab-team/crawlab#1111 · 1 comment · 0 reactions · 0 assignees ·
-
enhancement v0.6
crawlab-team/crawlab#1114 · 1 comment · 0 reactions · 0 assignees ·
-
bug v0.6
crawlab-team/crawlab#1120 · 0 comments · 0 reactions · 0 assignees ·
-
enhancement task v0.6
crawlab-team/crawlab#1155 · 1 comment · 0 reactions · 0 assignees ·
-
enhancement file-system v0.6
crawlab-team/crawlab#1174 · 1 comment · 0 reactions · 0 assignees ·
-
消息通知插件，发邮件收件人不能多个 Openbug notification v0.6
crawlab-team/crawlab#1184 · 2 comments · 0 reactions · 0 assignees ·
-
enhancement spider v0.6
crawlab-team/crawlab#1188 · 2 comments · 0 reactions · 0 assignees ·
-
Git Sync improvement Openenhancement git spider v0.6
crawlab-team/crawlab#1190 · 4 comments · 0 reactions · 0 assignees ·
-
定制展示数据表。 Openenhancement results v0.6
crawlab-team/crawlab#1198 · 0 comments · 0 reactions · 0 assignees ·
-
指定部分节点根据负载随机派发任务 Openenhancement node task v0.6
crawlab-team/crawlab#1215 · 0 comments · 0 reactions · 0 assignees ·
-
数据删除不起作用 Openenhancement results v0.6
crawlab-team/crawlab#1261 · 0 comments · 0 reactions · 0 assignees ·
-
文件编辑器配置能否保存？每次进去都初始化 Openenhancement file-edit v0.6
crawlab-team/crawlab#1265 · 1 comment · 0 reactions · 0 assignees ·
-
enhancement file-system v0.6
crawlab-team/crawlab#1273 · 3 comments · 0 reactions · 0 assignees ·
-
bug task v0.6
crawlab-team/crawlab#1281 · 10 comments · 0 reactions · 0 assignees ·
-
关于同一爬虫保存多种item的建议 Openenhancement results v0.6
crawlab-team/crawlab#1302 · 0 comments · 0 reactions · 0 assignees ·
-
教学视频 Openenhancement
crawlab-team/crawlab#1331 · 0 comments · 0 reactions · 0 assignees ·
-
enhancement
crawlab-team/crawlab#1335 · 3 comments · 0 reactions · 0 assignees ·
-
数据库涉及密码的存储等建议加密 Openenhancement
crawlab-team/crawlab#1339 · 0 comments · 0 reactions · 0 assignees ·
-
请教一下爬虫怎么获取之前爬取的结果? Openenhancement results
crawlab-team/crawlab#1354 · 0 comments · 0 reactions · 0 assignees ·
-
找不到module Openbug spider
crawlab-team/crawlab#1358 · 10 comments · 0 reactions · 0 assignees ·
-
SourceMap漏洞 Openbug
crawlab-team/crawlab#1363 · 0 comments · 0 reactions · 0 assignees ·
-
enhancement spider
crawlab-team/crawlab#1364 · 2 comments · 4 reactions · 0 assignees ·
-
enhancement sdk
crawlab-team/crawlab#1365 · 3 comments · 0 reactions · 0 assignees ·
-
建议数据项目隔离 Openenhancement spider
crawlab-team/crawlab#1366 · 1 comment · 4 reactions · 0 assignees ·
-
镜像太大啦，拉取都费劲，考虑优化一下吧 Openenhancement
crawlab-team/crawlab#1371 · 0 comments · 0 reactions · 0 assignees ·
-
Upload crawler file Openenhancement file-system
crawlab-team/crawlab#1372 · 0 comments · 0 reactions · 0 assignees ·
-
bug sdk
crawlab-team/crawlab#1373 · 2 comments · 0 reactions · 0 assignees ·
-
bug git
crawlab-team/crawlab#1382 · 0 comments · 0 reactions · 0 assignees ·
-
根据教程的单节点配置，部署失败 Openbug
crawlab-team/crawlab#1384 · 3 comments · 0 reactions · 0 assignees ·
-
bug
crawlab-team/crawlab#1385 · 4 comments · 0 reactions · 0 assignees ·
-
enhancement
crawlab-team/crawlab#1387 · 0 comments · 0 reactions · 0 assignees ·
-
bug schedule
crawlab-team/crawlab#1389 · 2 comments · 0 reactions · 0 assignees ·
-
bug schedule
crawlab-team/crawlab#1390 · 0 comments · 0 reactions · 0 assignees ·
-
bug task
crawlab-team/crawlab#1391 · 13 comments · 0 reactions · 0 assignees ·
-
bug logging task
crawlab-team/crawlab#1392 · 3 comments · 0 reactions · 0 assignees ·
-
bug task
crawlab-team/crawlab#1393 · 1 comment · 0 reactions · 0 assignees ·
-
enhancement task
crawlab-team/crawlab#1398 · 1 comment · 0 reactions · 0 assignees ·
-
bug sdk task
crawlab-team/crawlab#1402 · 0 comments · 0 reactions · 0 assignees ·
-
dependencies enhancement
crawlab-team/crawlab#1403 · 3 comments · 2 reactions · 0 assignees ·
-
使用SDK上传项目文件时无法删除文件 Openbug file-system sdk spider
crawlab-team/crawlab#1406 · 0 comments · 0 reactions · 0 assignees ·
-
master 内存占用很高，内存泄露. Openbug performance
crawlab-team/crawlab#1411 · 0 comments · 0 reactions · 0 assignees ·
-
创建项目级数据库，项目下爬虫共享该库。 Openenhancement spider
crawlab-team/crawlab#1414 · 0 comments · 0 reactions · 0 assignees ·
-
爬虫统计数据不对 Openbug results
crawlab-team/crawlab#1415 · 2 comments · 0 reactions · 0 assignees ·
-
是否考虑支持Git子项目管理功能？ Openenhancement git spider
crawlab-team/crawlab#1417 · 0 comments · 0 reactions · 0 assignees ·
-
enhancement
crawlab-team/crawlab#1418 · 1 comment · 0 reactions · 0 assignees ·
-
enhancement environment
crawlab-team/crawlab#1421 · 4 comments · 0 reactions · 0 assignees ·
-
duplicate enhancement
crawlab-team/crawlab#1422 · 1 comment · 0 reactions · 0 assignees ·
-
bug git
crawlab-team/crawlab#1425 · 2 comments · 0 reactions · 0 assignees ·
-
使用elastic数据源，存储数据失败 Openbug sdk
crawlab-team/crawlab#1427 · 1 comment · 0 reactions · 0 assignees ·
-
bug
crawlab-team/crawlab#1428 · 0 comments · 0 reactions · 0 assignees ·