Official Train-Test Splits for Clinical Note - ICD-9 Classification?

Prerequisites

• [ X] Put an X between the brackets on this line if you have done all of the following:
  • Checked the online documentation: https://mimic.physionet.org/about/mimic/
  • Checked that your issue isn't already addressed: https://github.com/MIT-LCP/mimic-code/issues?utf8=%E2%9C%93&q=

Description

Multiple publications* have been using this MIMIC-III to formulate a clinical document classification task by joining clinical note text (NOTEEVENTS.TEXT) with ICD-9 code (DIAGNOSES_ICD.ICD9_CODE). The lack of official train-test splits for this task has made these results incomparable due to separate splitting schemes. This is contrary to MIMIC's objective of delivering reproducible reusable experiments for clinical notes.

The solution I propose is that I could submit a PR containing a label-extracting notebook for 50 most frequent ICD-9 labels in the /benchmark/ directory that could designated as MIMIC-III's official train-test splits for this task. Would MIMIC's authors approve of this?

*Example Publications using ICD-9 classification:
Paper 1 name: Explainable Prediction of Medical Codes from Clinical Text
Paper link: https://arxiv.org/abs/1802.05695
Github Repo: https://github.com/jamesmullenbach/caml-mimic

Paper 2 name: An Empirical Evaluation of Deep Learning for ICD-9 Code Assignment using MIMIC-III Clinical Notes
Paper link: https://arxiv.org/abs/1802.02311
Github Repo: https://github.com/lsy3/clinical-notes-diagnosis-dl-nlp

Paper 3 name: Natural language processing of MIMIC-III clinical notes for identifying diagnosis and procedures with neural networks
Paper link: https://arxiv.org/pdf/1912.12397
Github Repo: https://github.com/SiddharthaNuthakki/NLP-Clinical-notes-Neural-Networks-AWD-LSTM-

Review the proposed label-extracting notebook for the 50 most frequent ICD-9 labels in /benchmark/, along with the cited publications and their splitting approaches. The issue needs agreement on an official train-test split before implementation can begin; done would be an accepted, reproducible benchmark definition and corresponding notebook.