Partial results during evaluation
Open
Nobody has claimed this yet.
feature_request
- Dominant language
- Python
- Stars
- 1k
- Forks
- 412
- Avg merge
- 6d 10h
- Merged PRs (30d)
- 3
Description
Now contestant will see the submission evaluation results only after all testcases are evaluated. But many times he/she is interested to receive at least some results as early as possible. So displaying evaluation results of already evaluated testcases during the evaluation would be another great improvement.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by tracing the submission evaluation flow and how evaluation results are currently delivered after all test cases finish. Done means contestants can receive results for completed test cases while evaluation is still running, with the existing final results still available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100