aboutcode-org / aboutcode-org/scancode-toolkit
[GSoC] Build NER training dataset from annotated rules
オープン
GSoC
- 主要言語
- Python
- スター
- 2.6k
- フォーク
- 791
- 平均マージ
- 1日 12時間
- マージ済み PR(30日)
- 5
説明
Tasks:
- Parse .RULE files and extract extract required phrase markers
- Propagate annotations (with CLI commands from #3924 ) to unannotated rules (with matching text) to expand the dataset
- Improve composite rules (AND/OR expressions where some aren't marked)
- Convert to BIOES labels
- Split into train/val/test by rule family
- Validate dataset quality
Timeline: Weeks 1-2 (current)
Deliverable: BIOES dataset ready for training (train/val/test splits)
コントリビューションガイド
評価
この issue はまだ評価されていません。