Pre-trained of best models

Hi @chenzimin ,

The models that you provided (~270GB) is currently too large for me to handle right now and using my current resource to re-train the best model according to your report is not possible for me right now either(I had to reduce the attention heads to 3 for the model to train without the out-of-memory error). From what I understand, the models that you provided in the onedrive is all the models that you trained during the ablation study so is it possible for you to upload only your best models (preferably somewhere I can `wget` my linux server cause using onedrive force me to first download it to my local then reupload to the server) ?
Thank you a lot.

Best regards,
Dang

No source file, test, or entry point is mentioned. First clarify which models from the ablation study are considered the best and where they should be hosted for wget access. Done means the selected pretrained models are available for download without requiring the full ~270GB collection.

Written by the indexing model from the issue text.