Did you guys share the pretraining code

I'm reading the paper. And for our project, the pretraining part is more helpful so I wonder if you guys also shared these code somewhere?
Also I have a question for the Detection of Direction Exceptions task. Why did you guys chose to use the majority direction in the positive set? Is it related to the way you guys sample the directions? If it's possible can I get more details?