allenai / allenai/scibert

JNLPBA Results

Open
#94 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
232
PR merge metrics
No merged PRs in 30d

Description

Hey,

thanks for your awesome work!

In the paper you write that you use macro F1-scores. On JNLPBA, however, we typically see micro average being ~4pp lower than the macro average and in the logs in your GitHub repository (https://github.com/allenai/scibert/tree/master/results) SciBERT seems to achieve micro F1-scores in the range of 77%. Thus, I’m wondering whether the macro in your paper might be a typo?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.