Is the vocabulary of BERT the same as the vocabulary of BERT-joint?

As mentioned in the [technical report,](https://arxiv.org/pdf/1901.08634.pdf) special markup tokens, such as "[Paragraph=N]" and "[Table=N]", were introduced. I think there are no such tokens in the vocabulary for BERT model. So the embedding table in the first layer of the transformer encoder seems different between BERT and BERT-joint. But the BERT-joint used a pre-trained BERT model. I had a hard time understanding this part. Any ideas?