PipedreamHQ / PipedreamHQ/pipedream

[BUG] Workflow is not discarding exceeded events when configuring execution control limits

Open
#12,861 0 comments 0 reactions 0 assignees View on GitHub
bug tracked internally triaged
Dominant language
JavaScript
Stars
11.7k
Forks
5.8k
Avg merge
3d 10h
Merged PRs (30d)
102

Description

**Describe the bug**
When limiting concurrency to one worker and setting the queue size to 1, I expect events to be dropped when more than one event is issued simultaneously. However, instead of being discarded, the events are getting queued.

**To Reproduce**
Steps to reproduce the behavior:

1. Create a workflow with an HTTP trigger
1. Go to the workflow configuration.
2. Set concurrency to one worker.
3. Set the queue size to 1.
4. Optionally set limit execution rate to 1 execution every minute
5. Send multiple events at the same time, e.g. `curl $HTTP_URL/$COUNTER` where COUNTER increases by 1 after each request
6. Observe that the events are queued rather than being discarded.

**Expected behavior**
Events should be discarded when more than one event is issued simultaneously, given the concurrency limit of one worker and a queue size of 1.

**Screenshots**
![image](https://github.com/user-attachments/assets/001e9043-efd6-448e-a8f2-bdb30cc71392)

Contributor guide

Open the contributing guide

Research direction

Start at the workflow's HTTP trigger and execution-control configuration, then reproduce the issue with one worker, queue size 1, and simultaneous curl requests. Verify that events beyond the configured capacity are discarded rather than queued, including when the execution rate limit is enabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.