deepspeedai / deepspeedai/DeepSpeed
[website] general broken links
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
It might be a good idea to run a scheduled link checker like https://linkchecker.github.io/linkchecker/ - I'm not sure it's the best tool but it will do the trick.
Add more urls to --no-follow-url to ensure it will check all outbound links from https://www.deepspeed.ai/, like https://deepspeed.readthedocs.io, otherwise it skips checking outbound links.
$ linkchecker -r -1 https://www.deepspeed.ai/ --no-follow-url https://deepspeed.readthedocs.io
[...]
URL `https://www.deepspeed.ai/news/2020/09/09/onebit-adam-blog-post.md'
Name `blog post'
Parent URL https://www.deepspeed.ai/features/, line 562, col 1
Real URL https://www.deepspeed.ai/news/2020/09/09/onebit-adam-blog-post.md
Check time 3.551 seconds
Size 2KB
Result Error: 404 Not Found
URL `https://deepspeed.readthedocs.io/en/latest/deepspeed.pt.html'
Name `here'
Parent URL https://www.deepspeed.ai/docs/config-json/, line 496, col 35
Real URL https://deepspeed.readthedocs.io/en/latest/deepspeed.pt.html
Check time 3.267 seconds
Result Error: 404 Not Found
URL `/docs'
Name `Docs'
Parent URL https://www.deepspeed.ai/docs/config-json/, line 170, col 11
Real URL https://www.deepspeed.ai/docs/
Check time 3.506 seconds
Size 2KB
Info Redirected to `https://www.deepspeed.ai/docs/'.
Result Error: 404 Not Found
10 threads active, 41 links queued, 237 links in 290 URLs checked, runtime 21 seconds
URL `https://www.deepspeed.ai/news/2020/09/09/onebit-adam-blog-post.html'
Name `blog post'
Parent URL https://www.deepspeed.ai/tutorials/onebit-adam/, line 418, col 73
Real URL https://www.deepspeed.ai/news/2020/09/09/onebit-adam-blog-post.html
Check time 2.810 seconds
Size 2KB
Result Error: 404 Not Found
URL `/2020'
Name `2020'
Parent URL https://www.deepspeed.ai/news/2020/10/28/progressive-layer-dropping-news.html, line 182, col 11
Real URL https://www.deepspeed.ai/2020/
Check time 3.112 seconds
Size 2KB
Info Redirected to `https://www.deepspeed.ai/2020/'.
Result Error: 404 Not Found
URL `/10'
Name `10'
Parent URL https://www.deepspeed.ai/news/2020/10/28/progressive-layer-dropping-news.html, line 192, col 11
Real URL https://www.deepspeed.ai/10
Check time 3.221 seconds
Size 2KB
Result Error: 404 Not Found
URL `/28'
Name `28'
Parent URL https://www.deepspeed.ai/news/2020/10/28/progressive-layer-dropping-news.html, line 202, col 11
Real URL https://www.deepspeed.ai/28
Check time 3.121 seconds
Size 2KB
Result Error: 404 Not Found
10 threads active, 24 links queued, 254 links in 291 URLs checked, runtime 26 seconds
URL `/09'
Name `09'
Parent URL https://www.deepspeed.ai/news/2020/09/08/sparse-attention-news.html, line 192, col 11
Real URL https://www.deepspeed.ai/09
Check time 3.086 seconds
Size 2KB
Result Error: 404 Not Found
URL `/08'
Name `08'
Parent URL https://www.deepspeed.ai/news/2020/09/08/sparse-attention-news.html, line 202, col 11
Real URL https://www.deepspeed.ai/08
Check time 3.390 seconds
Size 2KB
Result Error: 404 Not Found
10 threads active, 10 links queued, 268 links in 291 URLs checked, runtime 31 seconds
URL `/05'
Name `05'
Parent URL https://www.deepspeed.ai/news/2020/05/18/bert-record.html, line 192, col 11
Real URL https://www.deepspeed.ai/05
Check time 3.864 seconds
Size 2KB
Result Error: 404 Not Found
URL `/18'
Name `18'
Parent URL https://www.deepspeed.ai/news/2020/05/18/bert-record.html, line 202, col 11
Real URL https://www.deepspeed.ai/18
Check time 3.859 seconds
Size 2KB
Result Error: 404 Not Found
URL `/06'
Name `06'
Parent URL https://www.deepspeed.ai/news/2020/08/06/webinar-on-demand.html, line 202, col 11
Real URL https://www.deepspeed.ai/06
Check time 4.272 seconds
Size 2KB
Result Error: 404 Not Found
URL `/07'
Name `07'
Parent URL https://www.deepspeed.ai/news/2020/07/23/deepspeed-webinar.html, line 192, col 11
Real URL https://www.deepspeed.ai/07
Check time 3.813 seconds
Size 2KB
Result Error: 404 Not Found
URL `/23'
Name `23'
Parent URL https://www.deepspeed.ai/news/2020/07/23/deepspeed-webinar.html, line 202, col 11
Real URL https://www.deepspeed.ai/23
Check time 3.469 seconds
Size 2KB
Result Error: 404 Not Found
URL `/27'
Name `27'
Parent URL https://www.deepspeed.ai/news/2020/05/27/fastest-bert-training.html, line 202, col 11
Real URL https://www.deepspeed.ai/27
Check time 3.224 seconds
Size 2KB
Result Error: 404 Not Found
8 threads active, 0 links queued, 285 links in 296 URLs checked, runtime 36 seconds
URL `/02'
Name `02'
Parent URL https://www.deepspeed.ai/news/2020/02/13/turing-nlg.html, line 192, col 11
Real URL https://www.deepspeed.ai/02
Check time 3.646 seconds
Size 2KB
Result Error: 404 Not Found
URL `/13'
Name `13'
Parent URL https://www.deepspeed.ai/news/2020/02/13/turing-nlg.html, line 202, col 11
Real URL https://www.deepspeed.ai/13
Check time 3.813 seconds
Size 2KB
Result Error: 404 Not Found
URL `/03'
Name `03'
Parent URL https://www.deepspeed.ai/2020/03/17/reduce-scatter.html, line 182, col 11
Real URL https://www.deepspeed.ai/03
Check time 4.090 seconds
Size 2KB
Result Error: 404 Not Found
URL `/17'
Name `17'
Parent URL https://www.deepspeed.ai/2020/03/17/reduce-scatter.html, line 192, col 11
Real URL https://www.deepspeed.ai/17
Check time 4.114 seconds
Size 2KB
Result Error: 404 Not Found
Statistics:
Downloaded: 1.29MB.
Content types: 45 image, 67 text, 0 video, 0 audio, 2 application, 1 mail and 178 other.
URL lengths: min=20, max=336, avg=72.
That's it. 293 links in 296 URLs checked. 0 warnings found. 19 errors found.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by running the shown linkchecker command against https://www.deepspeed.ai/ with outbound links such as https://deepspeed.readthedocs.io included. Inspect the reported 404 URLs and their parent pages, then correct the broken links and verify that the checker no longer reports these errors. The proposed scheduled check is broader and is not specified further in the issue.
Written by the indexing model from the issue text.
Assessment
- Domain
- documentation, web-dev
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100