facebookresearch / facebookresearch/fairseq2
Perf drop with OMP_NUM_THREAD/MKL_NUM_THREADS
Open
documentation
enhancement
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 144
- Avg merge
- 4d 1h
- Merged PRs (30d)
- 1
Description
Thanks to @mavlyutovr's investigation we found out that the throughput of our TBB-based data pipeline API can drop significantly if OMP_NUM_THREADS and/or MKL_NUM_THREADS are not bound to a low thread count. We should investigate if there is anyway for us to mitigate this issue on our end. If not, we should document this behavior and advise users to be cautious about it.
Contributor guide
Assessment
This issue has not been assessed yet.