NanmiCoder / NanmiCoder/MediaCrawler
✨ 建议新增贝壳找房（beike.com）爬虫支持
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Python
- Stars
- 65.3k
- Forks
- 12.6k
- PR merge metrics
- No merged PRs in 30d
Description
需求背景
贝壳找房是国内最大的居住产业数字服务平台，覆盖新房、二手房、租房、小区、楼盘、经纪人等海量房产数据。目前项目已支持 7 个主流内容平台，但房产类平台还是空白，房产数据在市场分析、房价研究、租房选房、房产自媒体等场景下需求非常大。
建议支持的能力
- 关键词/城市搜索：按城市 + 区域搜索房源（二手房 / 新房 / 租房）
- 指定房源 ID 爬取：精确抓取单套房源的详情与挂牌信息
- 小区 / 楼盘数据：小区均价、在售/在租房源、历史成交
- 用户评价爬取：房源点评、小区口碑
- 经纪人 / 门店主页（可选）
技术建议
- 贝壳有完善的 Web 端（ke.com / beike.com），大部分数据通过 API 返回
- 同样可以复用项目现有的 CDP 模式（连接已有 Chrome 复用登录态），登录态缓存机制也直接适用
- 数据结构可以沿用现有
content + comment的存储模型，新增beike平台即可
使用场景举例
- 房产市场调研：按城市抓取挂牌价分布
- 租房比价：批量对比同区域房源
- 房产自媒体选题：小区口碑、楼盘热度的数据分析
感谢作者的维护！如果觉得有价值，希望考虑在后续版本中支持 🙏
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the repository’s existing platform crawlers, CDP mode, and login-state caching to understand the relevant entry points. Compare the existing content and comment storage model with the requested Beike capabilities, then define a smaller initial scope and its completion criteria before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100