DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA2

Could you publish the loss curves for both pretraining and finetuning?

Open
#49 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
90
PR merge metrics
No merged PRs in 30d

Description

Thank you for your excellent work. I am attempting to replicate the pretraining and lora finetuning processes, and I would like to confirm whether my model's convergence is reasonable.

Contributor guide

No contributing guide indexed for this repository

Research direction

Review the repository's pretraining and LoRA finetuning materials and determine where the corresponding loss outputs are recorded. Document or publish representative curves for both processes so users can compare their model convergence against the project's results.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.