conductor-oss / conductor-oss/conductor

Performance optimization issues during load testing

Open
#407 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
32.2k
Forks
1k
Avg merge
2d 3h
Merged PRs (30d)
37

Description

# Description

I'm experiencing performance issues when conducting load testing on the Conductor service. Here are the details。

# Environment

Conductor version: 3.21.12,
Conductor service node: 4
Operating system: [Debian 5.10.46-4 (2021-08-03) x86_64 GNU/Linux]
Hardware configuration: [CPU 8 cores, 32G RAM, storage 512G]

# Performance Issues Observed
Describe the specific performance problems you're encountering (e.g., high latency, low throughput, timeouts, etc.).
Include any error messages or warnings that appear during testing.

# Load Testing Setup
Tool used for load testing: [JMeter.]
Number of concurrent users/requests: 10/5min
Key metrics observed :
![Image](https://github.com/user-attachments/assets/46be8f46-4680-4ea7-8975-b31e11e3807a)

# Configuration

conductor.tasks.http.readTimeout=5000ms
conductor.tasks.http.connectTimeout=3000ms

#Timeout in milliseconds used by
conductor.app.system-task-queue-pop-timeout=0

#The number of threads to use to do background sweep on active workflows.
conductor.app.sweeper-thread-count=2

#The number of threads to be usde in Scheduler used for polling events from multiple event
#queues. By default, a thread count equal to the number of CPU cores is chosen.
conductor.app.event-queue-scheduler-poll-thread-count=2

#The number of messages to be polled from a default event queue in a single operation.
conductor.app.event-queue-poll-count=4

#The max number of the threads to be polled within the threadpool for system task workers.
conductor.app.system-task-max-poll-count=4

#The maximum number of threads to be allocated to the executor service threadpool.
conductor.app.executor-service-max-thread-count=4

# Expected Behavior
JVM config -Xms4096m -Xmx4096m

# Attachments

![Image](https://github.com/user-attachments/assets/c7f4f4e8-3e74-4e15-a385-9d5960a8adb8)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.