Automated build scripts
Nobody has claimed this yet.
- Dominant language
- JavaScript
- Stars
- 32
- Forks
- 8
- Avg merge
- 13m
- Merged PRs (30d)
- 1
Description
Add scripts to automate the generation of databases based on downloads from source.
The scripts would automate the process of downloading the source data, decompressing it (where relevant), importing it and saving the database.
This would ideally come in the form of terraform scripts which boot up one cloud instance per data source, allowing everything to be processed in parallel.
Additionally, we need to consider:
- Where the build artefacts (the database and the logs) are stored
- If we want to automatically merge all the sources into an 'everything.db' or leave that to the end user.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by mapping how source downloads, decompression, imports, and database saves currently work, then investigate the project's data sources and deployment conventions. Done means repeatable parallel builds, defined artifact and log storage, and an explicit decision about producing an everything.db.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- terraform
- Domain
- cloud, databases, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100