huggingface / huggingface/transfer-learning-conv-ai

Confusion in pretrained model.

Open
#52 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.8k
Forks
430
PR merge metrics
No merged PRs in 30d

Description

Hello.

I am trying to run your model and I have some confusion in your pre-trained model.

It seems that ``train.py`` trained the model with doublehead model, but in the `interact.py`, the code loads `LMHeadmodel`.

Why are they using different models?

So in the pre-trained model, actually, next sentence classification is not implemented?

Contributor guide

No contributing guide indexed for this repository

Research direction

Compare the model setup in train.py with the model loading in interact.py, starting at the training and pretrained-model entry points. Trace whether the doublehead and LMHeadmodel paths are intentional, then document which model is shipped and whether next-sentence classification is included.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.