CodeForPhilly / CodeForPhilly/MATchMapper

Write the Django API functions to handle the requests to import data from the scraping scripts

Open
#13 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7
Forks
5
PR merge metrics
No merged PRs in 30d

Description

Depending on the decision for issue #11, the Django API functions will work differently. If we have decided to not do a .exe file, we can just create one HTTP request function to initialize scraping and channeling the output from the scrapes directly into our database with Django's ORM model. If we decide to use a .exe file, we probably have to create multiple API functions to handle the output from the scraping differently depending on which source we scraped them from. ** The key idea behind the functions is to convert the json data into the django models before sending them into the database. We might include some logic behind how we will update key entities like providers and sites to solve the chicken-egg problems

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by resolving the decision in issue #11, then inspect the scraping scripts, Django API functions, and ORM models involved in the import flow. Done means the chosen request path converts scraper JSON into Django models, persists it, and accounts for updating providers and sites without unresolved entity-order problems.

Written by the indexing model from the issue text.

Assessment

Tech stack
django, python
Domain
api, backend, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.