CodeForPhilly / CodeForPhilly/MATchMapper

Script to convert scraped data (in csv or pandas df) to json format for Django

未关闭
#12 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
7
派生
5
PR 合并指标
30 天内没有已合并 PR

描述

Write a script that works with the output from the scraper (could be directly with .csv or the pandas df) and converts the output into json data that can be sent to the Django API to input into our database. ** Important: If you are taking this issue, make sure you make clear documentation as to whether you have decided to work directly with the pandas df or the csv format output from the scrapers. It would be best if you make a decision and let the rest of the team know. After making the decision, you should also reconfigure the scraping files such that they become functions with a boolean parameter that allows the user to decide if he or she wants the scraping scripts to output a .csv file or not.

贡献指南

这个仓库没有索引到贡献指南

调研方向

首先定位 scraper 文件并追踪其输出是 pandas DataFrame 还是 CSV,然后检查 Django API 的输入路径和数据库预期。确定并记录一种输入格式,添加转换为 JSON 的功能,并重新配置 scraping 文件以提供所请求的 CSV 输出选项。

由索引模型根据 Issue 内容生成。

评估

技术栈
django, pandas, python
领域
api, backend, data
Issue 类型
功能
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。