Cloud-CV/EvalAI-Starters

View on GitHub

How to create a challenge on EvalAI?

Stars: 86
Forks: 191
Open beginner issues: 0
Indexed issues: 21

Dominant language: Python
License: No license data
Last GitHub push: Oct 3, 2025
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted
PR merge metrics: No merged PRs in 30d

Open All

21 open issues indexed

Constraints on installing pip packages on workers? Open

Cloud-CV/EvalAI-Starters#53 · 2 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
There is no proper documentation about where the test annotation file Open

Cloud-CV/EvalAI-Starters#54 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Retrieving docker image from remote execution script Open

Cloud-CV/EvalAI-Starters#61 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Version 3.7.4 with arch x64 not found - Python Open

Cloud-CV/EvalAI-Starters#65 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Bug: assumption that repo is under account of owner of AUTH_TOKEN Open

Cloud-CV/EvalAI-Starters#70 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
competition is not initializing Open

Cloud-CV/EvalAI-Starters#81 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Errors when updating the challenge template Open

Cloud-CV/EvalAI-Starters#82 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Addition of a new leaderboard after challenge creation is not allowed. Open

Cloud-CV/EvalAI-Starters#83 · 0 comments · 4 reactions · 0 assignees · Indexed Sep 15, 2026
No evaluation_script_starter.py file Open

Cloud-CV/EvalAI-Starters#85 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
How to create a new virtual python3 environment for installating the worker requirements for remote challenge evaluation? Open

Cloud-CV/EvalAI-Starters#86 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Bad Request for Host a remote evaluation challenge Open

Cloud-CV/EvalAI-Starters#87 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Problem when submitting data Open

Cloud-CV/EvalAI-Starters#94 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add CI script using Github Actions for each PR Open

enhancement help wanted

Cloud-CV/EvalAI-Starters#98 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
unable to build Open

Cloud-CV/EvalAI-Starters#108 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
update ubuntu 20.04 to 22.04 for an ongoing challenge in EvalAI Open

Cloud-CV/EvalAI-Starters#111 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
a custom python pip packages error Open

Cloud-CV/EvalAI-Starters#114 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Error when pushing to challenge branch Open

Cloud-CV/EvalAI-Starters#115 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
More Examples Open

Cloud-CV/EvalAI-Starters#118 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
➕ Support Multiple Challenge Versions in Same Repository via Branches Open

Cloud-CV/EvalAI-Starters#119 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
missing starter eval Open

Cloud-CV/EvalAI-Starters#123 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Is there a way to force the scores submitted by participants to be displayed on the leaderboard? Here is my GitHub configuration. Open

Cloud-CV/EvalAI-Starters#128 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Cloud-CV/EvalAI-Starters

Get new issues in your inbox