DAMO-NLP-SG / DAMO-NLP-SG/HierEncDec

Why are all the predicted outputs the same?

Open
#2 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
8
Forks
1
PR merge metrics
No merged PRs in 30d

Description

I run the code on Multi-Xscience with the recommended setup. But I find all the predicted outputs on the test set are the same, as follows:
![image](https://github.com/DAMO-NLP-SG/HierEncDec/assets/48216295/69f08343-e5ad-4f24-addf-59e3bed3c8f5)

Do you have any idea about the reason? Thx.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the recommended setup on the Multi-Xscience test set and inspect the prediction-generation path and configuration used for inference. Compare the inputs and decoding behavior across examples; done means the cause of identical outputs is identified and predictions are no longer all the same.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.