google-research / google-research/language

Fine-tune REALM on a different set of documents for retrieval

Open
#82 1 comment 4 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.8k
Forks
362
PR merge metrics
No merged PRs in 30d

Description

Hi,
I was wondering if there is a way to take the pre-trained REALM model checkpoints and fine tune them on another much smaller set of documents ?
As a first step, it would suffice to just fine tune the ICT retriever.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.