acl-org / acl-org/acl-anthology
Metadata correction for 2026.smm4h-1.25
- Dominant language
- Python
- Stars
- 796
- Forks
- 408
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 34
Description
### JSON data block
```json
{
"anthology_id": "2026.smm4h-1.25",
"abstract": "Clinical language models are typically pre-trained with self-supervised objectives whose geometry reflects linguistic co-occurrence rather than clinical knowledge structure. For downstream tasks that operate directly on the representation space, without task-specific fine-tuning, this gap limits what the model can do. We introduce DOKTERBERT (Dutch Ontology-grounded Knowledge-injected Text Encoder for Representations using BERT), a Dutch clinical language model pre-trained with a structure-aware contrastive objective that aligns contextual span representations to SNOMED concept anchors, with negative pressure weighted by graph distance in the SNOMED hierarchy. We evaluate DOKTERBERT against three Dutch baselines (RobBERT, MedRoBERTa.nl, and a Dutch SapBERT variant) through supervised named entity recognition on MultiClinNER-nl and a representation analysis spanning retrieval, clustering, entity linking, and concept-level separation. On supervised NER, all four models perform comparably; on the representation evaluations, DOKTERBERT separates from every baseline. Standard fine-tuning evaluation obscures pre-training-level differences in representation quality that representation analysis exposes, and these differences matter for clinical applications that depend on embedding geometry."
}
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.