ai-forever / ai-forever/ner-bert

should we calculate F1-score with micro-average or macro-average?

Open
#26 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
407
Forks
100
PR merge metrics
No merged PRs in 30d

Description

In the jupyter notebook "conll2003 BERTBiLSTMCRF" in the "examples" folder, the result report is as follow:

![image](https://user-images.githubusercontent.com/43842380/69053773-26e84980-0a45-11ea-8732-4f790227b0e6.png)

I notice you put macro-avg "0.9221" in the "README.md" file, but it seems like that the code at "https://paperswithcode.com/sota/named-entity-recognition-ner-on-conll-2003" adopt the micro-avg value as the final F1-value.

I would appreciate it very much if you can tell me why, thanks.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.