alibaba / alibaba/EasyNLP

where are you selecting for layers 4-14 in Freeprompt

Open
#365 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.2k
Forks
257
PR merge metrics
No merged PRs in 30d

Description

The paper discusses the selection of layers 4-14 of Self attention in the copying. I can't seem to find where in the code it is actually done. It appears to em that the 16 layers are being copied?

Also, is it possible to share the code for the Ablation in Figure 10 in the paper?

Many thanks.

Contributor guide

No contributing guide indexed for this repository

Research direction

No file or test is named. Search the repository for the Freeprompt implementation and the self-attention layer-copying logic, then compare the selected range with layers 4–14 described in the paper. Check whether code for the Figure 10 ablation is present; done means identifying the relevant entry point and documenting the available selection and ablation code.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.