AOSSIE-Org / AOSSIE-Org/DebateAI

[FEATURE]: integrate DeBERTa-base LocalLLMClient for EDIS fallacy detection

未关闭
#377 4 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
TypeScript
星标
84
派生
198
平均合并
2 天 19 小时
30 天内合并 PR
30

描述

## Summary
Proposes integrating a fine-tuned DeBERTa-base model as the
LocalLLMClient fallback implementation for EDIS signal extraction.

## Why DeBERTa over DistilBERT
DeBERTa-base significantly outperforms DistilBERT on multi-label
fallacy classification due to its disentangled attention mechanism
which handles nuanced reasoning language better.

## Model Details
- Base model: microsoft/deberta-base
- Training data: 9,400 debate-style examples
- Fallacy classes: 8
- Validation F1-macro: 1.0
- Hard OOD test: 13/15
- Model: https://huggingface.co/RowdyI7er/DebateLLM

## Integration
The model implements the LocalLLMClient interface described
in the EDIS architecture — providing a zero-API-cost fallback
for fallacy detection without any changes to the existing
debate flow or Elo pipeline.

### Additional Context

_No response_

### Code of Conduct

- [x] I have joined the [Discord server](https://discord.gg/hjUhu33uAn) and will post updates there
- [x] I have searched existing issues to avoid duplicates

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。