4paradigm / 4paradigm/OpenMLDB

mirror site issue

Open
#3,524 0 comments 0 reactions 1 assignee Claimed by @vagetablechicken View on GitHub
Dominant language
C++
Stars
1.7k
Forks
331
Avg merge
12d 12h
Merged PRs (30d)
1

Description

- [x] spark support sha256sum
- [ ] ~~a workflow to check mirror site files sha256sum, if not match, scp files(the mirror machine is slow to download, so scp)~~ can't ssh through external IP, so can't add workflow
- [x] scp set timeout to avoid slow periodic tasks
- [x] change mirror site, can't by ip now, use openmldb.com, ref #3617
- [x] gen sha256sum file on mirror site
- [ ] periodically check sha256sum, if no or mismatch
- [x] cp with timeout(if network is bad, abort and retry later, don't be stubborn)

Contributor guide

Open the contributing guide

Research direction

Look for existing mirror site scripts or workflows in the repository, likely in a scripts/ or .github/ directory. Understand the current scp and sha256sum generation processes. The task involves setting up a periodic check for file integrity on the mirror site, which may require cron jobs or GitHub Actions. Test the scp timeout and sha256sum verification locally before implementing the periodic check.

Written by the indexing model from the issue text.

Assessment

Tech stack
bash, shell
Domain
devops, infrastructure
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
40/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.