alibaba / alibaba/ROLL

请问ROLL是否支持GLM-4.7的多机多卡lora的DPO训练

Open
#305 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
3.4k
Forks
312
Avg merge
1h 2m
Merged PRs (30d)
2

Description

如题,是否支持GLM-4.7的多机多卡 megatron 的 lora DPO训练

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by checking ROLL's existing Megatron LoRA and DPO support and its multi-node, multi-GPU training entry points. Determine whether GLM-4.7 is supported; done means documenting the support status or defining the implementation scope needed for this configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.