facebookresearch / facebookresearch/fairscale

FSDP: illegal memory access when flatten=True

Open
#689 13 comments 0 reactions 2 assignees Claimed by @zhaojuanmao View on GitHub
FSDP
Dominant language
Python
Stars
3.4k
Forks
293
PR merge metrics
No merged PRs in 30d

Description

When working on a model with FSDP wrapping, running into an illegal memory access crash and it went away with flatten=False. I will be debugging it.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.