huggingface / huggingface/evaluate

`evaluate-cli create` fails with `subprocess.CalledProcessError`

Open
#519 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

I tried to create a new metric by doing this:
```bash
evaluate-cli create "pseudo_log_likelihood" --module_type "metric"
```
but I get the following error message:
```
Traceback (most recent call last):
File "/home/tai/master/annotation/temporal-common-sense/.venv/bin/evaluate-cli", line 8, in
sys.exit(main())
^^^^^^
File "/home/tai/master/annotation/temporal-common-sense/.venv/lib/python3.11/site-packages/evaluate/commands/evaluate_cli.py", line 97, in main
subprocess.run(
File "/usr/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['git', 'clone', 'https://huggingface.co/spaces/Tai-Mai/pseudo_log_likelihood']' returned non-zero exit status 128.
```

The space is created nonetheless and I have to delete it manually from the web. Otherwise, if I try to run the command above again, I get this error message:
```
Could not create Space for module at hf.co/spaces/Tai-Mai/pseudo_log_likelihood. Make sure this space does not exist already.
```

Could you help me resolve the issue?

Some additional information that might or might not be relevant:
* Arch Linux
* Virtual environment using poetry
* Authenticated via SSH key

Many thanks in advance for any help.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.