Using SciBERT on GIEC report

Hi everybody,

We are a group of uni students currently working on a research project within a NLP class. We extracted text from a GIEC report and build a Knowledge Graph from it. We wanted to know if it was possible to use a pre-trained version of SciBERT and train it with our own KG.

As we are pretty new to NLP, we don't have any idea of the feasibility of this, or how to start with ?

Would any of you have any indication ?

Thanks,
Hugo M