apache / apache/solr-orbit-workloads
Migrate dataset hosting from CloudFront to ASF infrastructure
Open
- Dominant language
- Python
- Stars
- 2
- Forks
- 4
- Avg merge
- 3h 43m
- Merged PRs (30d)
- 3
Description
Both `workload.json` files reference a privately-owned CloudFront distribution (`dbyiw3u3rf9yr.cloudfront.net`) for corpus downloads. This is not ASF-controlled infrastructure and creates an external dependency for all benchmark runs.
## Tasks
- Identify appropriate ASF-managed storage via an Infra ticket (e.g. `downloads.apache.org` or ASF S3)
- Upload all corpus files (full + 1k variants, both `.zst` and `.bz2`)
- Update base URLs in `geonames/workload.json` and `nyc_taxis/workload.json`
- Verify checksums after migration
- Document here and in solr-orbit repo our policy on corpus storage and how to upload
Contributor guide
Assessment
This issue has not been assessed yet.