AOSSIE-Org / AOSSIE-Org/DebateAI

[FEATURE]: integrate DeBERTa-base LocalLLMClient for EDIS fallacy detection

Abierto
#377 4 comentarios 0 reacciones 0 asignados Ver en GitHub
enhancement
Lenguaje dominante
TypeScript
Estrellas
84
Forks
198
Merge medio
2 d 19 h
PR fusionados (30 d)
30

Descripción

## Summary
Proposes integrating a fine-tuned DeBERTa-base model as the
LocalLLMClient fallback implementation for EDIS signal extraction.

## Why DeBERTa over DistilBERT
DeBERTa-base significantly outperforms DistilBERT on multi-label
fallacy classification due to its disentangled attention mechanism
which handles nuanced reasoning language better.

## Model Details
- Base model: microsoft/deberta-base
- Training data: 9,400 debate-style examples
- Fallacy classes: 8
- Validation F1-macro: 1.0
- Hard OOD test: 13/15
- Model: https://huggingface.co/RowdyI7er/DebateLLM

## Integration
The model implements the LocalLLMClient interface described
in the EDIS architecture — providing a zero-API-cost fallback
for fallacy detection without any changes to the existing
debate flow or Elo pipeline.

### Additional Context

_No response_

### Code of Conduct

- [x] I have joined the [Discord server](https://discord.gg/hjUhu33uAn) and will post updates there
- [x] I have searched existing issues to avoid duplicates

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.