clearlydefined / clearlydefined/crawler
Harvesting not working
- Dominant language
- JavaScript
- Stars
- 60
- Forks
- 38
- Avg merge
- 1h 49m
- Merged PRs (30d)
- 1
Description
I submitted harvesting requests for the following Python packages using the [clearlydefined](https://clearlydefined.io/harvest) website, first on 2024-02-28 in a single query, and then on 2024-02-29, each one in a separate query, in a separate browser tab. As of today, 2024-03-04, none of these packages were harvested:
| package name | 2024-02-28 query | 2024-02-29 query |
| ------------- | ------------- | ------------- |
| pypi/pypi/-/nvidia-cublas-cu12/12.1.3.1 | 1 | 1 |
| pypi/pypi/-/nvidia-cuda-cupti-cu12/12.1.105 | 1 | 1 |
| pypi/pypi/-/nvidia-cuda-nvrtc-cu12/12.1.105 | | 1 |
| pypi/pypi/-/nvidia-cuda-runtime-cu12/12.1.105 | 1 | 1 |
| pypi/pypi/-/nvidia-cudnn-cu12/8.9.2.26 | 1 | 1 |
| pypi/pypi/-/nvidia-cufft-cu12/11.0.2.54 | 1 | 1 |
| pypi/pypi/-/nvidia-curand-cu12/10.3.2.106 | | 1 |
| pypi/pypi/-/nvidia-cusolver-cu12/11.4.5.107 | 1 | 1 |
| pypi/pypi/-/nvidia-cusparse-cu12/12.1.0.106 | 1 | 1 |
| pypi/pypi/-/nvidia-nccl-cu12/2.19.3 | 1 | 1 |
| pypi/pypi/-/nvidia-nvjitlink-cu12/12.3.101 | 1 | 1 |
| pypi/pypi/-/nvidia-nvtx-cu12/12.1.105 | 1 | 1 |
| pypi/pypi/-/onnxruntime/1.17.1 | | 1 |
| pypi/pypi/-/tensorboard-data-server/0.7.2 | | 1 |
| pypi/pypi/-/tensorboard/2.16.2 | | 1 |
| pypi/pypi/-/thop/0.1.1.post2207130030 | 1 | 1 |
| pypi/pypi/-/torch/2.2.1 | 1 | 1 |
| pypi/pypi/-/torchvision/0.17.1 | 1 | 1 |
| pypi/pypi/-/triton/2.2.0 | | 1 |
The harvesting either does not reliably work or takes a very long time (5 days and counting). Either way I believe this requires a fix or at least extra documentation. I will also appreciate help with harvesting these specific packages.
Contributor guide
Assessment
This issue has not been assessed yet.