hackforla / hackforla/lucky-parking
Create data cleaning pipeline in AWS
Open
complexity: large
feature: automation/GitHub actions
feature: database
missing: milestone
priority: high
role: devops
size: 13+pt
- Dominant language
- Jupyter Notebook
- Stars
- 37
- Forks
- 60
- Avg merge
- 13h 32m
- Merged PRs (30d)
- 5
Description
### Overview
We need to create a data cleaning pipeline that takes in raw input data from the Socrata API and updates the AWS database with the correctly formatted geospatial data
### Action items
- [x] Create list of data cleaning steps
- [x] Create code turn clean data accordingly
- [x] Decide on database technology
- [ ] Do some tests
- [ ] Deploy pipeline to AWS
### Resources/Instructions
- [ ] [Socrata API documentation](https://dev.socrata.com/foundry/data.lacity.org/wjz9-h9np)
Contributor guide
Assessment
This issue has not been assessed yet.