Evaluations stuck for VQA Challenge 2021 phase 2
Open
- Dominant language
- Python
- Stars
- 2k
- Forks
- 984
- Avg merge
- 2h 54m
- Merged PRs (30d)
- 14
Description
Hello, @gchhablani @RishabhJain2018 sorry for bothering you. My submission files to the test dev phase 2 of the VQA Challenge 2021 have been stuck at the "Submitted" state for a long time. Since my current work heavily depends on this benchmark, please help me fix this situation. Thank you
Contributor guide
Research direction
No files, tests, or entry points are named. Start by tracing the VQA Challenge 2021 phase 2 submission workflow and the state transition from "Submitted" to evaluation, then reproduce the stuck submission and verify that it reaches the expected terminal state.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- django, python
- Domain
- backend, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100