NVIDIA / NVIDIA/cccl

[BUG]: thrust::count_if and copy_if performance on Grace and x86 10x+ / 20x+ slower than libstdc++

Open
#1,709 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

### Is this a duplicate?

- [X] I confirmed there appear to be no [duplicate issues](https://github.com/NVIDIA/cccl/issues) for this bug and that I agree to the [Code of Conduct](CODE_OF_CONDUCT.md)

### Type of Bug

Performance

### Component

Thrust

### Describe the bug

See title, the performance of count_if and copy_if are very low on NVIDIA Grace CPU.

### How to Reproduce

This self-contained file reproduces: https://github.com/gonzalobg/cpp_hpc_tutorial/blob/master/labs/cpp/lab1_select/solutions/exercise1.cpp

This one isolates copy_if: https://github.com/gonzalobg/cpp_hpc_tutorial/blob/master/labs/cpp/lab1_select/solutions/copy_if.cpp

The performance of transform_inclusive_scan is also quite low (~3x lower) than libstdc++, see
https://github.com/gonzalobg/cpp_hpc_tutorial/blob/master/labs/cpp/lab1_select/solutions/exercise2.cpp

### Expected behavior

Close to peak CPU bandwidth.

### Reproduction link

_No response_

### Operating System

_No response_

### nvidia-smi output

_No response_

### NVCC version

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.