aboutcode-org / aboutcode-org/vulnerablecode

Failed to run NVD Importer

Đang mở
#1,212 0 bình luận 0 reaction 0 người được giao Xem trên GitHub
Ngôn ngữ chính
Python
Star
702
Fork
328
Merge trung bình
3 ngày 8 giờ
Pull request đã merge (30 ngày)
3

Mô tả

NVD importer works without any error when I created the database but after running all the improvers and trying to import nvd again, I got this error
```
(venv) ziad@ziad:~/PycharmProjects/vulnerablecode$ python manage.py import --all
Importing data using vulnerabilities.importers.nvd.NVDImporter
Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 929, in get_or_create
return self.get(**kwargs), False
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 650, in get
raise self.model.DoesNotExist(
vulnerabilities.models.Advisory.DoesNotExist: Advisory matching query does not exist.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "vulnerabilities_advisory_aliases_unique_content_i_b954a5fb_uniq"
DETAIL: Key (aliases, unique_content_id, date_published)=(["CVE-2023-28427"], fa9ff225871b09e3ba40310c32f76a87, 2023-03-28 21:15:00+00) already exists.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/management/commands/import.py", line 60, in import_data
ImportRunner(importer).run()
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/import_runner.py", line 44, in run
count = process_advisories(advisory_datas=advisory_datas, importer_name=importer_name)
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/import_runner.py", line 58, in process_advisories
obj, created = Advisory.objects.get_or_create(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 936, in get_or_create
return self.create(**params), True
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 671, in create
obj.save(force_insert=True, using=self.db)
File "/home/ziad/PycharmProjects/vulnerablecode/vulnerabilities/models.py", line 823, in save
super().save(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 812, in save
self.save_base(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 863, in save_base
updated = self._save_table(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 1006, in _save_table
results = self._do_insert(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/base.py", line 1047, in _do_insert
return manager._insert(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/query.py", line 1791, in _insert
return query.get_compiler(using=using).execute_sql(returning_fields)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1660, in execute_sql
cursor.execute(sql, params)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 102, in execute
return super().execute(sql, params)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
return self._execute_with_wrappers(
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
with self.db.wrap_database_errors:
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/home/ziad/PycharmProjects/vulnerablecode/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
return self.cursor.execute(sql, params)
django.db.utils.IntegrityError: duplicate key value violates unique constraint "vulnerabilities_advisory_aliases_unique_content_i_b954a5fb_uniq"
DETAIL: Key (aliases, unique_content_id, date_published)=(["CVE-2023-28427"], fa9ff225871b09e3ba40310c32f76a87, 2023-03-28 21:15:00+00) already exists.

Failed to run importer vulnerabilities.importers.nvd.NVDImporter. Continuing...
CommandError: 1 failed!: vulnerabilities.importers.nvd.NVDImporter

```

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.