How to use new BPE codes and vocab to generate parallel data

I have a few questions.

1. I have used the data in the folder [https://github.com/facebookresearch/CodeGen/tree/main/data/test_dataset](https://github.com/facebookresearch/CodeGen/tree/main/data/test_dataset) learned BPE codes and vocab using Monolingual Functions mode. I want to know how to use the **.tok files** in the zip file https://dl.fbaipublicfiles.com/transcoder/test_set/transcoder_test_set.zip and generate files like **test.cpp_sa-java_sa.cpp_sa.pth** using my bpe codes and vocab?

2. What is the contents of file **test.cpp_sa-java_sa.cpp_sa.pth** ? Also what is the difference between files **test.cpp_sa-java_sa.cpp_sa.pth** and **test.cpp_sa-java_sa.java_sa.pth** ?

3. I first preprocessed data in Monolingual mode, learned BPE codes, and then did my MLM training. Then I preprocessed the data in Monolingual Functions mode and learned new BPE codes and vocab. My question is, which vocab have you used to train CodeGen? Also, why two different BPE codes are learned?