Implement retraining pipeline
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 10
- Forks
- 6
- PR merge metrics
- No merged PRs in 30d
Description
Create a new project under the model proposed by #2 which iteratively trains and validates on a stretch of data, cleans (using the deepclean.inference.pseudo code) the next stretch, then retrains (and validates) the previously trained model on that stretch and cleans on the stretch after that, etc. The analysis from this project should be the ASD/ASDR and associated metrics on all of the cleaned stretches. This will better forecast the production performace of DeepClean and allow for search and optimization over retraining parameters e.g. the retraining period.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the model proposed in issue #2 and the deepclean.inference.pseudo code. Define how the new project will iterate through training, validation, cleaning, and retraining across data stretches. Done means it produces ASD/ASDR and associated metrics for all cleaned stretches and supports searching retraining parameters such as the retraining period.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100