apache / apache/jmeter

Result Status Action Handler when set to 'Continue' is not overriding the 'Action to be taken after a Sampler error' in Thread Group

Open
#5,506 3 comments 0 reactions 0 assignees View on GitHub
P2
Dominant language
Java
Stars
9.5k
Forks
2.3k
Avg merge
1d 22h
Merged PRs (30d)
5

Description

**mark.pilon** ([Bug 65175](https://bz.apache.org/bugzilla//show_bug.cgi?id=65175&redirect=false)):
Hello, I have an possible bug with the Result Status Action Handler in JMeter 5.4.1.

Test Case
- My Thread Group's 'Action to be taken after a Sampler error' is 'Start Next Thread Group'. My loop count is 2.
- I have three HTTP Samplers each going to google.com, google.com/xyz (which is expected to fail with 404), and google.com//services respectively.
- I have a 'Result Status Action Handler' set to Continue that is at the same level as the HTTP Samplers (ie at the root of the Thread Group).

Expected result:
- Sampler for google.com should pass
- Sampler for google.com/xyz fails but continues
- Sampler for google.com/services should pass
- Loop 1 ends
- Sampler for google.com should pass
- Sampler for google.com/xyz fails but continues
- Sampler for google.com/services should pass
- Loop 2 ends
- Test stops

Actual Result:
- Sampler for google.com should pass
- Sampler for google.com/xyz fails
- Loop 1 ends without executing google.com/services
- Sampler for google.com should pass
- Sampler for google.com/xyz fails
- Loop 2 ends without executing google.com/services
- Test stops

I think the problem may only be with the 'Continue' option in 'Result Status Action Handler' since every other option seems to stand up under test.

For example, if I have the same test case but set 'Result Status Action Handler' set to 'Stop Test' the test acts as expected.
- Sampler for google.com should pass
- Sampler for google.com/xyz fails and the test stops
- Loop 2 is not executed

I've attached the jmx file which illustrates the problem.

Thanks,
Mark

Created attachment [resultStatusActionHandlerIssue.jmx](https://apache.github.io/jmeter-bugzilla-attachments/75/65175/37765/resultStatusActionHandlerIssue.jmx): Jmx file that illustrates the issue
resultStatusActionHandlerIssue.jmx

````xml




false
true
false







startnextloop

false
2

1
1
false


true



0






google.com




GET
true
false
true
false









google.com



/xyz
GET
true
false
true
false









google.com



/services
GET
true
false
true
false







false

saveConfig


true
true
true
true
true
true
true
true
false
true
true
false
false
false
true
false
false
false
true
0
true
true
true
true
true
true






false

saveConfig


true
true
true
true
true
true
true
true
false
true
true
false
false
false
true
false
false
false
true
0
true
true
true
true
true
true






````

Severity: normal
OS:

Contributor guide

Open the contributing guide

Research direction

Start by running the attached resultStatusActionHandlerIssue.jmx with JMeter 5.4.1 and compare the Continue behavior with the reported Thread Group setting. Trace the Result Status Action Handler and sampler execution path; done means a failed sampler with Continue still allows the following sampler to run across both loop iterations.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.