How did you generate the input data files like data.pkl, word2id and word_embedding.pkl ?

Firstly thanks for the great ACL paper and open source code!

I have a question on the data preprocessing part. How did you generate the input data files like data.pkl, word2id,vocab.txt and word_embedding.pkl ? Let's take UDC as the example. The raw data only contains train.txt/valid.txt/test.txt. I checked your code and there are no scripts on generating these files like data.pkl and word_embedding.pkl. Could you also upload these data preprocessing scripts ?

Begin with the UDC raw files train.txt, valid.txt, and test.txt, then trace where data.pkl, word2id, vocab.txt, and word_embedding.pkl are consumed. Compare the expected formats with the ACL paper’s preprocessing description; done means reproducible preprocessing scripts and documented commands generate all four files.

Written by the indexing model from the issue text.