aigc-apps / aigc-apps/VideoX-Fun

Quick questions on resources used for the full train

Open
#103 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.3k
Forks
188
Avg merge
2d 22h
Merged PRs (30d)
3

Description

Couple quick questions if possible! Looking to do a full finetune as an experiment with a i2v dataset I've been working on.

  • train.sh:
    • I note a 2e-5 learning rate. Was this the learning used for the full train of the model the entire time? Or was a learning rate schedule ran or something? Was 2e-5 the ending learning rate, or starting learning rate where it was lowered throughout the training? Trying to understand if this 2e-5 is a reasonable starting learning rate for a finetune, or if I should start it closer to 1e-4 as seen in the Lora config, then slowly ramp it down to 2e-5 towards the end.
    • train_batch_size of 1, does this mean a batch size of 1 was used? Should this be raised?
  • Training resources
    • How many iterations/steps were ran?
    • Curious approximately how much the full train cost and how long with what resources?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading train.sh and the LoRA config referenced in the questions, then trace the full-training settings and recorded run details. Done means documenting the learning-rate behavior, batch size, number of steps, training resources, duration, and approximate cost; the payload names no tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.