Ekultek / Ekultek/Zeus-Scanner

Unhandled exception (783ab9e4)

Open
#874 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
999
Forks
245
PR merge metrics
No merged PRs in 30d

Description

Zeus version:
`1.5.2.21b875`

Firefox version:
`failed to start`

Geckodriver version:
`geckodriver-v0.19.0-linux64.tar.gz`

Error info:
```Traceback (most recent call last):
File "zeus.py", line 333, in
verbose=opt.runInVerbose, forward=opt.forwardedForRandomIP)
File "/root/Zeus-Scanner/zeus-scanner/var/blackwidow/__init__.py", line 150, in blackwidow_main
found = crawler.scrape_page_for_links(url)
File "/root/Zeus-Scanner/zeus-scanner/var/blackwidow/__init__.py", line 77, in scrape_page_for_links
given_url, agent=self.user_agent, proxy=self.proxy
File "/root/Zeus-Scanner/zeus-scanner/lib/core/common.py", line 335, in get_page
req = requests.get(url, params=headers, proxies=proxies, verify=False, timeout=20)
File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 70, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 56, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 488, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 609, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 473, in send
raise ConnectionError(err, request=request)
ConnectionError: ('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))
```

Running details:
`Linux-4.15.0-88-generic-x86_64-with-Ubuntu-18.04-bionic`

Commands used:
`zeus.py -b https://sergiuv.be/movie/pages/series.vue`

Log file info:
```2020-03-25 10:49:07,760;zeus-log;INFO;log file being saved to '/root/Zeus-Scanner/zeus-scanner/log/zeus-log-5.log'
2020-03-25 10:49:07,760;zeus-log;INFO;using default search engine
2020-03-25 10:49:07,760;zeus-log;INFO;starting blackwidow on 'https://sergiuv.be/movie/pages/series.vue'
2020-03-25 10:49:07,820;zeus-log;INFO;connection test succeeded, continuing
2020-03-25 10:49:07,820;zeus-log;INFO;crawling given URL 'https://sergiuv.be/movie/pages/series.vue' for links
2020-03-25 10:49:07,830;zeus-log;ERROR;Zeus has hit an unexpected error and cannot continue, error code '('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))'
Traceback (most recent call last):
File "zeus.py", line 333, in
verbose=opt.runInVerbose, forward=opt.forwardedForRandomIP)
File "/root/Zeus-Scanner/zeus-scanner/var/blackwidow/__init__.py", line 150, in blackwidow_main
found = crawler.scrape_page_for_links(url)
File "/root/Zeus-Scanner/zeus-scanner/var/blackwidow/__init__.py", line 77, in scrape_page_for_links
given_url, agent=self.user_agent, proxy=self.proxy
File "/root/Zeus-Scanner/zeus-scanner/lib/core/common.py", line 335, in get_page
req = requests.get(url, params=headers, proxies=proxies, verify=False, timeout=20)
File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 70, in get
return request('get', url, params=params, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 56, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 488, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 609, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 473, in send
raise ConnectionError(err, request=request)
ConnectionError: ('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))

2020-03-25 10:49:28,241;zeus-log;INFO;Zeus got an unexpected error and will automatically create an issue for this error, please wait
2020-03-25 10:49:28,241;zeus-log;INFO;getting authorization
2020-03-25 10:49:28,242;zeus-log;INFO;extracting traceback from log file
2020-03-25 10:49:28,242;zeus-log;INFO;attempting to get firefox browser version
2020-03-25 10:49:28,245;zeus-log;ERROR;failed to run firefox
```

Contributor guide

Open the contributing guide

Research direction

Start by running the reported `zeus.py -b https://sergiuv.be/movie/pages/series.vue` command, then inspect `lib/core/common.py` line 335 and its callers in `var/blackwidow/__init__.py` lines 77 and 150. Determine how the reported `requests` `ConnectionError` is handled during crawling; done should be defined by the tool's behavior for this failure instead of the shown unhandled exception.

Written by the indexing model from the issue text.

Assessment

Tech stack
linux, python
Domain
cli, networking
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.