allenai / allenai/scispacy

Chunking seems to not be working properly

Ouverte
#326 4 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
enhancement help wanted
Langage dominant
Python
Étoiles
2k
Forks
258
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

Hello and thank you for creating this tool!

I have been trying to use the noun_chunks with your pipelines but it does not seem to be working correctly. I have tried with _en_core_sci_sm_, _en_core_sci_md_ and _en_core_sci_lg_. For example when I input the sentence "CCR5(+) and CXCR3(+) T cells are increased in multiple sclerosis and their ligands MIP-1alpha and IP-10 are expressed in demyelinating brain lesions." I only get "CCR5(+", "CXCR3(+" and "T cells" as chunks and I would expect more chunks. For example, using spaCys _en_core_web_trf_ I get "CCR5(+) and CXCR3(+) T cells", "multiple sclerosis", "their ligands", "MIP-1alpha", "IP-10" and "brain lesions".

Is the chunking supposed to work in a similar way as spaCys pipelines or have I misinterpreted something?

Thank you in advance!

Best regards

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.