Unused modulation heads
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1k
- Forks
- 174
- PR merge metrics
- No merged PRs in 30d
Description
Hi !
I noticed that in the Air Pollution model, modulation heads are created in the decoder for all variables but never used for meteorological variables since we do not predict a difference for these variables.
Was this intentional to improve code clarity maybe?
If not I can submit a PR if you want 🙂. The checkpoint file would need to be updated though
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting the Air Pollution model's decoder, focusing on modulation heads for meteorological variables and how the checkpoint is loaded. Confirm whether those heads are unused by design; done means the unnecessary heads are addressed consistently and the required checkpoint update remains compatible.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100