facebookresearch / facebookresearch/fairseq2
Experiment with expandable_segments
Open
enhancement
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 144
- Avg merge
- 4d 1h
- Merged PRs (30d)
- 1
Description
There have been reports that setting `PYTORCH_CUDA_ALLOC_CONF` environment variable to "expandable_segments:True" can reduce device memory use in certain cases (see https://github.com/pytorch/torchtune/issues/1185), experiment with it and see if it brings any gain in our recipes.
Contributor guide
Assessment
This issue has not been assessed yet.