Create Base Benchmark and CodiEsp Modules
未关闭
- 主要语言
- Python
- 星标
- 1
- 派生
- 1
- PR 合并指标
- 30 天内没有已合并 PR
描述
Base class must provide interfacing functions
- [ ] constructor receiving a config defining benchmark by name:str and chunking level
- [ ] get test dataset including true labels, output columns: text, y_true, multi-index: report id, [paragraph id, [sentence id, [phrase id]]]
- [ ] get train dataset including true labels
- [ ] provide two chunking strategies (submodule): complete report, sentence level
Behaviour: assert supported chunking strategy is available for benchmark, e.g., phrase level is not available for codiESP (issue already created)
Provide CodiEsp implementation and basic unit tests.
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。