Include training data in docker container
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 9.3k
- Forks
- 4.4k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 4
Description
Problem: Currently the tutorial site build takes 1h40m on a g3-8x instance. Reducing this time will allow the community to interact and help us improve documentation. Target: <30m
Solution: Public training data hardly changes. Include tutorial training data in the containers used to build the tutorial site and modify the makefiles and build scripts to check for the existence of this data prior to downloading data.
Impact: 15-20min saved
Related: #315 #316 #317
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the container definitions, Makefiles, and build scripts used for the tutorial site, then trace where training data is downloaded. Update the container and build flow so existing data is detected before downloading; done means the tutorial build uses the included data and approaches the stated under-30-minute target.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, python
- Domain
- build-system, data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100