AOSSIE-Org / AOSSIE-Org/PictoPy

BUG/PERF: Critical CPU Thrashing & UI Lag due to Unconstrained ONNX Threading

Abierto
#1,169 2 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
283
Forks
679
Merge medio
7 d 2 h
PR fusionados (30 d)
3

Descripción

**Is there an existing issue for this?**
- [x] I have searched the existing issues

None of the currently open issues directly address the "Thread Explosion" (CPU Thrashing) caused by ONNX Runtime. Though a few of them do sound like _cousins_ to the problem like #1034 and #1033

---

### **What happened?**

The application currently experiences significant performance degradation (high Load Average, UI stutters, system unresponsiveness) during the image syncing/indexing process.

After some investigation, I found out that the backend initializes `onnxruntime.InferenceSession` using the default constructor without specifying thread limits. When combined with the existing `ProcessPoolExecutor` architecture, this causes a "thread explosion" that thrashes the CPU and performance.

---

### **Cause**

The backend handles parallelism by spawning multiple worker processes. Inside each worker, the ONNX models (YOLO.py, FaceNet.py) are initialized with default settings. [By default, ONNX Runtime attempts to use all available CPU cores](https://onnxruntime.ai/docs/performance/tune-performance/threading.html#numa-support-and-performance-tuning).

If the host machine has 8 cores and the `ProcessPool` spawns 4 workers:
- 4 Workers × 8 Threads per Worker = **32 Heavy Compute Threads** fighting for 8 physical cores.

**Result:** The OS scheduler spends more time context-switching than processing, causing the UI thread to starve and the indexing speed to effectively decrease.

---

### **Proposed Solution**

Since we are achieving parallelism at the **Process Level** (multiple images processed at once), we must disable parallelism at the **Model Level**.

We need to explicitly configure the `SessionOptions` to limit each model instance to a single thread.

---

**Record**

- [x] I agree to follow this project's Code of Conduct
- [x] I want to work on this issue

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.