aboutcode-org / aboutcode-org/vulnerablecode

Github importer failure

Open
#583 3 comments 0 reactions 0 assignees View on GitHub
bug Data collection Priority: medium tracing-and-logging
Dominant language
Python
Stars
702
Forks
328
Avg merge
3d 8h
Merged PRs (30d)
3

Description

After running the github import with GH_TOKEN set I get
```
❯ python manage.py import github
Importing data from github
Traceback (most recent call last):
File "/home/shivam/work/vulnerablecode/vulnerabilities/management/commands/import.py", line 110, in _import_data
ImportRunner(importer, batch_size).run(cutoff_date=cutoff_date)
File "/home/shivam/work/vulnerablecode/vulnerabilities/import_runner.py", line 89, in run
process_advisories(data_source)
File "/usr/lib/python3.9/contextlib.py", line 79, in inner
return func(*args, **kwds)
File "/home/shivam/work/vulnerablecode/vulnerabilities/import_runner.py", line 116, in process_advisories
advisory_batches = chain(data_source.updated_advisories(), data_source.added_advisories())
File "/home/shivam/work/vulnerablecode/vulnerabilities/importers/github.py", line 178, in updated_advisories
return self.batch_advisories(self.process_response())
File "/home/shivam/work/vulnerablecode/vulnerabilities/importers/github.py", line 258, in process_response
self.set_version_api(ecosystem)
File "/home/shivam/work/vulnerablecode/vulnerabilities/importers/github.py", line 213, in set_version_api
self.set_api(self.collect_packages(ecosystem))
File "/home/shivam/work/vulnerablecode/vulnerabilities/importers/github.py", line 175, in set_api
asyncio.run(self.version_api.load_api(packages))
File "/usr/lib/python3.9/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete
return future.result()
File "/home/shivam/work/vulnerablecode/vulnerabilities/package_managers.py", line 74, in load_api
await asyncio.gather(
File "/home/shivam/work/vulnerablecode/vulnerabilities/package_managers.py", line 313, in fetch
resp = await session.request(method="GET", url=endpoint)
File "/home/shivam/work/vulnerablecode/venv/lib/python3.9/site-packages/aiohttp/client.py", line 625, in _request
resp.raise_for_status()
File "/home/shivam/work/vulnerablecode/venv/lib/python3.9/site-packages/aiohttp/client_reqrep.py", line 1000, in raise_for_status
raise ClientResponseError(
aiohttp.client_exceptions.ClientResponseError: 404, message='Not Found', url=URL('https://api.nuget.org/v3/registration5-semver1/github.com/beego/beego/v2/nuget/index.json')
Failure to import data from github. Continuing...
CommandError: 1 failed!: github

```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.