mitodl / mitodl/ol-data-platform
All the MicroMasters program data should flow into int__micromasters__* tables
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 51
- Forks
- 6
- Avg merge
- 2d 19h
- Merged PRs (30d)
- 113
Description
Description/Context
Currently, DEDP program data are in int__micromasters__* tables. But any non DEDP program will not be in these MicroMasters intermediate tables, so it would require code changes if any new MicroMasters program added to MITx Online database in the near future.
Since we've added program_type in raw__mitxonline__app__postgres__courses_program, which identify any MicroMasters program. We should be able to modify these subqueries to include all MicroMasters programs, not just DEDP.
Plan/Design
All MicroMasters program data should be in these tables
- int__micromasters__course_certificates
- int__micromasters__course_grades
- int__micromasters__program_certificates
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in src/ol_dbt/models/intermediate/micromasters/subqueries and inspect how the models currently limit data to DEDP, using program_type from raw__mitxonline__app__postgres__courses_program. Done means the course certificate, course grade, and program certificate intermediate tables include data for every MicroMasters program, not only DEDP.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- sql
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100