Cloud-CV/evalai-cli

View on GitHub

:cloud: :rocket: Official EvalAI Command Line Tool

Stars: 57
Forks: 70
Open beginner issues: 0
Indexed issues: 56

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Jun 14, 2026
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted
PR merge metrics: No merged PRs in 30d

Open All

56 open issues indexed

Auto Docs Generation Open

dev-ops good first issue

Cloud-CV/evalai-cli#5 · 2 comments · 1 reaction · 1 assignee · Indexed Sep 15, 2026
Modify docstrings in functions Open

docs enhancement

Cloud-CV/evalai-cli#46 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Create challenge configuration using CLI Open

enhancement help wanted

Cloud-CV/evalai-cli#61 · 3 comments · 1 reaction · 1 assignee · Indexed Sep 15, 2026
Abstracting the request pattern. Open

enhancement good first issue GSOC-2019 help wanted

Cloud-CV/evalai-cli#81 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Challenge Stats should not be shown to the participant users. Open

bug enhancement good first issue

Cloud-CV/evalai-cli#89 · 7 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Remove challenge start & end date Open

enhancement good first issue help wanted

Cloud-CV/evalai-cli#97 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Upcoming Command not working Open

Cloud-CV/evalai-cli#104 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Multiple tokens Open

enhancement good first issue help wanted

Cloud-CV/evalai-cli#105 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Show error message while submitting when user doesn't participate in a challenge. Open

bug good first issue help wanted

Cloud-CV/evalai-cli#106 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add command for creating a challenge Open

Cloud-CV/evalai-cli#119 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add unit tests for evalai push command Open

enhancement good first issue GSOC-2019 help wanted

Cloud-CV/evalai-cli#145 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Check if docker is running on host machine before using evalai push Open

bug enhancement good first issue GSOC-2019 help wanted priority-high

Cloud-CV/evalai-cli#154 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add unit tests for download_file command Open

enhancement good first issue GSOC-2019 help wanted

Cloud-CV/evalai-cli#157 · 10 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add docs for auth token Open

Cloud-CV/evalai-cli#160 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Fix error message when submission limit is exhausted for a phase Open

Cloud-CV/evalai-cli#169 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[docs] Documentation on usage of download_file Open

Cloud-CV/evalai-cli#171 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[bug, #todo] hardcoded host url Open

Cloud-CV/evalai-cli#172 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Some CLI commands not working Open

Cloud-CV/evalai-cli#174 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
download_file arguments - bucket and key Open

Cloud-CV/evalai-cli#175 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
calling evaluate() infinite times if submission id is NoneType Open

Cloud-CV/evalai-cli#176 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
No code written under evalai-cli/evalai/urls.py Open

Cloud-CV/evalai-cli#177 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Many files need to be updated and added in evalai-cli/docs/ Open

Cloud-CV/evalai-cli#178 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[Doc] : Readme.md - Description and CLI commands to be updated. Open

Cloud-CV/evalai-cli#179 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[Docs] Custom backend configuration documentation Open

Cloud-CV/evalai-cli#180 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
[Docs] readthedocs documentation build failed. Open

Cloud-CV/evalai-cli#199 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[PyPI docs] Link to project homepage on PyPI broken Open

Cloud-CV/evalai-cli#200 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[New feature] Add feature to reset_token (logout) Open

Cloud-CV/evalai-cli#205 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[bug] token.json empty causes cli to crash while using get_token command Open

Cloud-CV/evalai-cli#215 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[error message] get_token command gives out wrong message Open

Cloud-CV/evalai-cli#216 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Hardcoded AWS region Open

Cloud-CV/evalai-cli#218 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Remove replication of code to get_token command. Open

Cloud-CV/evalai-cli#223 · 10 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[new feature] Create shell script to set up development environment Open

Cloud-CV/evalai-cli#225 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Fix Progress bar for uploading a docker image. Open

Cloud-CV/evalai-cli#229 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Challenge submission error handling Open

Cloud-CV/evalai-cli#231 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[bug] Improper implementation of click causes errors while handling exceptions Open

Cloud-CV/evalai-cli#232 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[enhancement] Define wrapper functions for click's echo function Open

Cloud-CV/evalai-cli#234 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add Code of Conduct file Open

Cloud-CV/evalai-cli#238 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add Dark Mode option on the docs Open

Cloud-CV/evalai-cli#239 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove duplicated code Open

Cloud-CV/evalai-cli#241 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[enhancement] Use different color for command usage examples within messages Open

Cloud-CV/evalai-cli#243 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
EvalAI-cli Utils not fully tested Open

Cloud-CV/evalai-cli#244 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove replication of code to get current host Open

Cloud-CV/evalai-cli#264 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[docs] Add documentation for login command Open

Cloud-CV/evalai-cli#271 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add supported python versions to documentation Open

Cloud-CV/evalai-cli#272 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
socket.timeout error when submitting image using `evalai push` Open

priority-high

Cloud-CV/evalai-cli#275 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Write tests for uploading files through pre-signed urls Open

Cloud-CV/evalai-cli#278 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add tests for get_user_access_token method Open

Cloud-CV/evalai-cli#307 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Keyerror on logging errors when found in making a call to api Open

Cloud-CV/evalai-cli#313 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add command to download all submissions of a challenge Open

Cloud-CV/evalai-cli#321 · 10 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Submission metadata appears to be dropped when submitting large files Open

Cloud-CV/evalai-cli#334 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Cloud-CV/evalai-cli

Get new issues in your inbox