acl-org / acl-org/acl-anthology

Metadata correction for 2026.smm4h-1.25

Open
#9,062 2 comments 0 reactions 0 assignees View on GitHub
correction metadata waiting
Dominant language
Python
Stars
796
Forks
408
Avg merge
3d 13h
Merged PRs (30d)
34

Description

### JSON data block

```json
{
"anthology_id": "2026.smm4h-1.25",
"abstract": "Clinical language models are typically pre-trained with self-supervised objectives whose geometry reflects linguistic co-occurrence rather than clinical knowledge structure. For downstream tasks that operate directly on the representation space, without task-specific fine-tuning, this gap limits what the model can do. We introduce DOKTERBERT (Dutch Ontology-grounded Knowledge-injected Text Encoder for Representations using BERT), a Dutch clinical language model pre-trained with a structure-aware contrastive objective that aligns contextual span representations to SNOMED concept anchors, with negative pressure weighted by graph distance in the SNOMED hierarchy. We evaluate DOKTERBERT against three Dutch baselines (RobBERT, MedRoBERTa.nl, and a Dutch SapBERT variant) through supervised named entity recognition on MultiClinNER-nl and a representation analysis spanning retrieval, clustering, entity linking, and concept-level separation. On supervised NER, all four models perform comparably; on the representation evaluations, DOKTERBERT separates from every baseline. Standard fine-tuning evaluation obscures pre-training-level differences in representation quality that representation analysis exposes, and these differences matter for clinical applications that depend on embedding geometry."
}
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.