LAION-AI / LAION-AI/CLAP

finetune on which branch

Open
#102 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.3k
Forks
213
PR merge metrics
No merged PRs in 30d

Description

i have 2 questions:

  1. released music model is trained both audio and text branch or just trained on audio branch?
  2. i followed the finetune_script finding it only finetuneed audio branch for classification, is that right? if i want to finetune both text and audio branch i should unfreeze the text branch ?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the mentioned finetune_script and trace how the audio and text branches are selected or frozen for classification. Confirm the training behavior of the released music model and document whether both branches are trained, including what is required to fine-tune the text branch.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.