4paradigm / 4paradigm/OpenMLDB
mirror site issue
- Vorherrschende Sprache
- C++
- Sterne
- 1.7k
- Forks
- 331
- Ø Merge
- 12 T. 12 Std.
- Gemergte PRs (30 T.)
- 1
Beschreibung
- [x] spark support sha256sum
- [ ] ~~a workflow to check mirror site files sha256sum, if not match, scp files(the mirror machine is slow to download, so scp)~~ can't ssh through external IP, so can't add workflow
- [x] scp set timeout to avoid slow periodic tasks
- [x] change mirror site, can't by ip now, use openmldb.com, ref #3617
- [x] gen sha256sum file on mirror site
- [ ] periodically check sha256sum, if no or mismatch
- [x] cp with timeout(if network is bad, abort and retry later, don't be stubborn)
Beitragsleitfaden
Rechercherichtung
Look for existing mirror site scripts or workflows in the repository, likely in a scripts/ or .github/ directory. Understand the current scp and sha256sum generation processes. The task involves setting up a periodic check for file integrity on the mirror site, which may require cron jobs or GitHub Actions. Test the scp timeout and sha256sum verification locally before implementing the periodic check.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- bash, shell
- Bereich
- devops, infrastructure
- Issue-Typ
- Feature
- Schwierigkeit
- 3/5
- Geschätzter Aufwand
- 1-2 Tage
- Aktivitätsstatus
- Veraltet
- Klarheit
- Größtenteils klar
- Anfängerfreundlichkeit
- 40/100