h2oai / h2oai/datatable

Sort Performance Degradating when nthreads bigger than machine cores

Open
#2,249 2 comments 0 reactions 0 assignees View on GitHub
performance question
Dominant language
C++
Stars
1.9k
Forks
164
Avg merge
7h 31m
Merged PRs (30d)
1

Description

I wonder why sort operation is sensitive on nthreads.
Test on my machine, when nthreads is just one more than the cores.
it will occur Significant performance degradation

29 threads vs 20 threads 【machine is 28 core】

![image](https://user-images.githubusercontent.com/19861628/71069877-93757600-21b4-11ea-8342-bf095957e7b0.png)

# machine:

cpu:Intel(R) Xeon(R) Gold 5117 CPU @ 2.00GHz
cores:28
processor : 27
vendor_id : GenuineIntel
cpu family : 6
model : 85
model name : Intel(R) Xeon(R) Gold 5117 CPU @ 2.00GHz
stepping : 4
microcode : 0x2000043
cpu MHz : 2000.000
cache size : 19712 KB
physical id : 1
siblings : 14
core id : 14
cpu cores : 14

MEM: 263412544k

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.