[bug] 404 not found when download model
- Lenguaje dominante
- Python
- Estrellas
- 428
- Forks
- 58
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
when I execute the command `detect-definition`, this part [code](https://github.com/allenai/scholarphi/blob/bf92dd9a14c7b15f1dc8725549d09099b1cd6012/data-processing/entities/definitions/nlp.py#L93-L96) try to download model https://scholarphi.s3-us-west-1.amazonaws.com/joint_symnick_abbrexp_termdef.zip but failure.
```shell
2021-10-18 21:10:10,067 [INFO]: Launching command detect-definitions
2021-10-18 21:10:10,512 [DEBUG]: Loading Spacy models (this may take some time).
2021-10-18 21:10:55,311 [DEBUG]: Created cache directory for models at ./cache/DocDef2+AI2020+W00_model
2021-10-18 21:11:12,084 [DEBUG]: Downloading model from https://scholarphi.s3-us-west-1.amazonaws.com/joint_symnick_abbrexp_termdef.zip. Warning: this will take a long time.
2021-10-18 21:12:17,923 [ERROR]: Unexpected exception processing papers: ['0801.4750']
Traceback (most recent call last):
File "/yuhang/draft/Lab/scholarphi/data-processing/scripts/run_pipeline.py", line 93, in run_commands_for_arxiv_ids
run_command(command)
File "/yuhang/draft/Lab/scholarphi/data-processing/scripts/commands.py", line 95, in run_command
for result in cmd.process(item):
File "/yuhang/draft/Lab/scholarphi/data-processing/entities/definitions/commands/detect_definitions.py", line 609, in process
model = DefinitionDetectionModel(prediction_type)
File "/yuhang/draft/Lab/scholarphi/data-processing/entities/definitions/nlp.py", line 93, in __init__
urllib.request.urlretrieve(
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 247, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
Traceback (most recent call last):
File "/opt/conda/envs/scholarphi/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/opt/conda/envs/scholarphi/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/root/.vscode-server/extensions/ms-python.python-2021.10.1336267007/pythonFiles/lib/python/debugpy/__main__.py", line 45, in
cli.main()
File "/root/.vscode-server/extensions/ms-python.python-2021.10.1336267007/pythonFiles/lib/python/debugpy/../debugpy/server/cli.py", line 444, in main
run()
File "/root/.vscode-server/extensions/ms-python.python-2021.10.1336267007/pythonFiles/lib/python/debugpy/../debugpy/server/cli.py", line 285, in run_file
runpy.run_path(target_as_str, run_name=compat.force_str("__main__"))
File "/opt/conda/envs/scholarphi/lib/python3.8/runpy.py", line 265, in run_path
return _run_module_code(code, init_globals, run_name,
File "/opt/conda/envs/scholarphi/lib/python3.8/runpy.py", line 97, in _run_module_code
_run_code(code, mod_globals, init_globals,
File "/opt/conda/envs/scholarphi/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/yuhang/draft/Lab/scholarphi/data-processing/scripts/run_pipeline.py", line 506, in
digest_for_papers = run_commands_for_arxiv_ids(
File "/yuhang/draft/Lab/scholarphi/data-processing/scripts/run_pipeline.py", line 100, in run_commands_for_arxiv_ids
raise exc
File "/yuhang/draft/Lab/scholarphi/data-processing/scripts/run_pipeline.py", line 93, in run_commands_for_arxiv_ids
run_command(command)
File "/yuhang/draft/Lab/scholarphi/data-processing/scripts/commands.py", line 95, in run_command
for result in cmd.process(item):
File "/yuhang/draft/Lab/scholarphi/data-processing/entities/definitions/commands/detect_definitions.py", line 609, in process
model = DefinitionDetectionModel(prediction_type)
File "/yuhang/draft/Lab/scholarphi/data-processing/entities/definitions/nlp.py", line 93, in __init__
urllib.request.urlretrieve(
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 247, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/opt/conda/envs/scholarphi/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
2021-10-18 21:12:31,976 [INFO]: Internal process exited
```
I have tried to access it through a web browser and got the same result.

How to solve it?
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.