CodeForPhilly / CodeForPhilly/MATchMapper
Script to convert scraped data (in csv or pandas df) to json format for Django
- 主要语言
- Python
- 星标
- 7
- 派生
- 5
- PR 合并指标
- 30 天内没有已合并 PR
描述
Write a script that works with the output from the scraper (could be directly with .csv or the pandas df) and converts the output into json data that can be sent to the Django API to input into our database. ** Important: If you are taking this issue, make sure you make clear documentation as to whether you have decided to work directly with the pandas df or the csv format output from the scrapers. It would be best if you make a decision and let the rest of the team know. After making the decision, you should also reconfigure the scraping files such that they become functions with a boolean parameter that allows the user to decide if he or she wants the scraping scripts to output a .csv file or not.
贡献指南
这个仓库没有索引到贡献指南
调研方向
首先定位 scraper 文件并追踪其输出是 pandas DataFrame 还是 CSV,然后检查 Django API 的输入路径和数据库预期。确定并记录一种输入格式,添加转换为 JSON 的功能,并重新配置 scraping 文件以提供所请求的 CSV 输出选项。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- django, pandas, python
- 领域
- api, backend, data
- Issue 类型
- 功能
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 基本清楚
- 新手友好度
- 35/100