aboutcode-org / aboutcode-org/vulnerablecode

Failed to run NVD Importer

Abierto
#1,212 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
702
Forks
328
Merge medio
3 d 8 h
PR fusionados (30 d)
3

Descripción

NVD importer works without any error when I created the database but after running all the improvers and trying to import nvd again, I got this error
```
(venv) ziad@ziad:~/PycharmProjects/vulnerablecode$ python manage.py import --all
Importing data using vulnerabilities.importers.nvd.NVDImporter
Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 929, in get_or_create
return self.get(**kwargs), False
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 650, in get
raise self.model.DoesNotExist(
vulnerabilities.models.Advisory.DoesNotExist: Advisory matching query does not exist.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "vulnerabilities_advisory_aliases_unique_content_i_b954a5fb_uniq"
DETAIL: Key (aliases, unique_content_id, date_published)=(["CVE-2023-28427"], fa9ff225871b09e3ba40310c32f76a87, 2023-03-28 21:15:00+00) already exists.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/management/commands/import.py", line 60, in import_data
ImportRunner(importer).run()
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/import_runner.py", line 44, in run
count = process_advisories(advisory_datas=advisory_datas, importer_name=importer_name)
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/import_runner.py", line 58, in process_advisories
obj, created = Advisory.objects.get_or_create(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 936, in get_or_create
return self.create(**params), True
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 671, in create
obj.save(force_insert=True, using=self.db)
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/models.py", line 823, in save
super().save(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 812, in save
self.save_base(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 863, in save_base
updated = self._save_table(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 1006, in _save_table
results = self._do_insert(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 1047, in _do_insert
return manager._insert(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 1791, in _insert
return query.get_compiler(using=using).execute_sql(returning_fields)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1660, in execute_sql
cursor.execute(sql, params)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 102, in execute
return super().execute(sql, params)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
return self._execute_with_wrappers(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
with self.db.wrap_database_errors:
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
django.db.utils.IntegrityError: duplicate key value violates unique constraint "vulnerabilities_advisory_aliases_unique_content_i_b954a5fb_uniq"
DETAIL: Key (aliases, unique_content_id, date_published)=(["CVE-2023-28427"], fa9ff225871b09e3ba40310c32f76a87, 2023-03-28 21:15:00+00) already exists.

Failed to run importer vulnerabilities.importers.nvd.NVDImporter. Continuing...
CommandError: 1 failed!: vulnerabilities.importers.nvd.NVDImporter

```

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.