where are you selecting for layers 4-14 in Freeprompt
- Dominant language
- Python
- Stars
- 2.2k
- Forks
- 257
- PR merge metrics
- No merged PRs in 30d
Description
The paper discusses the selection of layers 4-14 of Self attention in the copying. I can't seem to find where in the code it is actually done. It appears to em that the 16 layers are being copied?
Also, is it possible to share the code for the Ablation in Figure 10 in the paper?
Many thanks.
Contributor guide
No contributing guide indexed for this repository
Research direction
No file or test is named. Search the repository for the Freeprompt implementation and the self-attention layer-copying logic, then compare the selected range with layers 4–14 described in the paper. Check whether code for the Figure 10 ablation is present; done means identifying the relevant entry point and documenting the available selection and ablation code.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100