microsoft / microsoft/onnxruntime

Why is MLAS_MAXIMUM_THREAD_COUNT set to 16?

Open
#18,581 3 comments 0 reactions 1 assignee Claimed by @yufenglee View on GitHub
quantization
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the issue

I am doing some testing on cpus that have way more than 16 cores. I am seeing that MLAS is setting the max thread number to 16. Is there any reasons behind it?

### To reproduce

onnxruntime/core/mlas/lib/mlasi.h:290

### Urgency

_No response_

### Platform

Linux

### OS Version

Centos

### ONNX Runtime Installation

Built from Source

### ONNX Runtime Version or Commit ID

1.16.0

### ONNX Runtime API

C++

### Architecture

ARM64

### Execution Provider

Default CPU

### Execution Provider Library Version

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.