AOSSIE-Org / AOSSIE-Org/DebateAI

[Feature Proposal] Explainable Score Analysis System

Open
#220 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
84
Forks
198
Avg merge
2d 19h
Merged PRs (30d)
30

Description

### Is your feature request related to a problem?

Yes. Currently, users receive a final score/rating at the conclusion of a debate, but there is a lack of transparency regarding the "why" behind the numbers. This "Black Box" scoring makes it difficult for debaters to identify specific areas for improvement, such as whether they struggled with logical consistency, oratorical delivery, or rebuttal effectiveness.

---

### Description of the Proposed Feature

The Explainable Score Analysis (ESA) system aims to decompose the aggregate score into granular, interpretable components.
This feature will provide users with a detailed post-match report that balances quantitative data with qualitative insights.

---

### Key Components:

- Categorical Breakdown: Scores divided into specific pillars (e.g., Argument Strength, Evidence Quality, Rebuttal Efficiency, and Delivery).
- Sentiment/Tone Analysis: Feedback on whether the user's tone was appropriate for the debate context.
- Critical "Turning Points": Identifying specific exchanges in the transcript where the user gained or lost the lead.
- Actionable Coaching: 2–3 specific "Next Steps" generated by the AI based on the weaknesses identified.

---

### User Impact

- Educational Growth: Users can target specific skills (e.g., "I need to work on my rebuttals").
- Trust & Transparency: Users are less likely to feel "cheated" by an AI judge if they can see the logic behind the deduction.
- Engagement: Detailed feedback loops encourage users to return and try to improve specific sub-scores.

---

### Proposed Implementation Ideas

- Backend: Update the LLM prompt instructions to return a structured JSON object containing both the total score and a breakdown by criteria.
- Frontend: Introduce a "Score Summary Card" and a "Deep Dive" tab in the post-debate UI.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.