Azure / Azure/azure-sdk-for-python
metric name does not match
Aperta
customer-reported
Evaluation
needs-team-attention
question
Service Attention
- Lingua principale
- Python
- Stelle
- 5.6k
- Fork
- 3.4k
- Merge medio
- 2g
- PR unite (30g)
- 217
Descrizione
- **Package Name**: azure-ai-evaluation
- **Package Version**: 1.16.2
- **Operating System**:linux
- **Python Version**: 3.11
**Describe the bug**
The metrics are missing after evaluation. After investigating, it seems that:
for example with self_harm evaluation:
SDK sends ["name": "self_harm"] in the request payload (snake_case)
API (2025-11-15-preview) returns ["metric": "SelfHarm"] in the response (PascalCase)
SDK in _parse_eval_result() compares "SelfHarm" == "self_harm" → False → result discarded
Because of this, all metrics are discarded in the evaluation process.
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.