aboutcode-org / aboutcode-org/vulnerablecode

Failed to run NVD Importer

Ouverte
#1,212 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
702
Forks
328
Merge moyen
3 j 8 h
PR mergées (30 j)
3

Description

NVD importer works without any error when I created the database but after running all the improvers and trying to import nvd again, I got this error
```
(venv) ziad@ziad:~/PycharmProjects/vulnerablecode$ python manage.py import --all
Importing data using vulnerabilities.importers.nvd.NVDImporter
Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 929, in get_or_create
return self.get(**kwargs), False
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 650, in get
raise self.model.DoesNotExist(
vulnerabilities.models.Advisory.DoesNotExist: Advisory matching query does not exist.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "vulnerabilities_advisory_aliases_unique_content_i_b954a5fb_uniq"
DETAIL: Key (aliases, unique_content_id, date_published)=(["CVE-2023-28427"], fa9ff225871b09e3ba40310c32f76a87, 2023-03-28 21:15:00+00) already exists.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/management/commands/import.py", line 60, in import_data
ImportRunner(importer).run()
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/import_runner.py", line 44, in run
count = process_advisories(advisory_datas=advisory_datas, importer_name=importer_name)
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/import_runner.py", line 58, in process_advisories
obj, created = Advisory.objects.get_or_create(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 936, in get_or_create
return self.create(**params), True
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 671, in create
obj.save(force_insert=True, using=self.db)
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/models.py", line 823, in save
super().save(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 812, in save
self.save_base(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 863, in save_base
updated = self._save_table(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 1006, in _save_table
results = self._do_insert(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 1047, in _do_insert
return manager._insert(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 1791, in _insert
return query.get_compiler(using=using).execute_sql(returning_fields)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1660, in execute_sql
cursor.execute(sql, params)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 102, in execute
return super().execute(sql, params)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
return self._execute_with_wrappers(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
with self.db.wrap_database_errors:
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
django.db.utils.IntegrityError: duplicate key value violates unique constraint "vulnerabilities_advisory_aliases_unique_content_i_b954a5fb_uniq"
DETAIL: Key (aliases, unique_content_id, date_published)=(["CVE-2023-28427"], fa9ff225871b09e3ba40310c32f76a87, 2023-03-28 21:15:00+00) already exists.

Failed to run importer vulnerabilities.importers.nvd.NVDImporter. Continuing...
CommandError: 1 failed!: vulnerabilities.importers.nvd.NVDImporter

```

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.