get error when running Latency Simulation test
- Dominant language
- Scala
- Stars
- 6.8k
- Forks
- 1.2k
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 2
Description
## Environment details:
* ubuntu 18
* Docker version 20.10.20, build 9fdeb9c
## Steps to reproduce the issue:
1. I successfully installed openWhisk based on the tutorial https://github.com/apache/openwhisk/blob/master/tools/ubuntu-setup/README.md
2. I started test using https://github.com/apache/openwhisk/tree/master/tests/performance
3.
```
root@node0:/users/openwhisk# OPENWHISK_HOST="172.17.0.1" PAUSE_BETWEEN_INVOKES="20" MEAN_RESPONSE_TIME="10000" API_KEY=`cat ansible/files/auth.guest` ./gradlew gatlingRun-org.apache.openwhisk.LatencySimulation
Build using Scala 2.12
Scala sub-project 'gatling_tests' doesn't have Scoverage applied and will be ignored in parent project aggregation
> Task :tests:performance:gatling_tests:buildArtifacts
Test zip artifacts already built, skipping
> Task :tests:performance:gatling_tests:gatlingRun-org.apache.openwhisk.LatencySimulation
Simulation org.apache.openwhisk.LatencySimulation started...
13:51:30.359 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.389 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.391 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.429 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.431 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.469 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.499 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
13:51:30.501 [WARN ] i.g.h.e.r.DefaultStatsProcessor - Request 'Warm java:default invocation' failed for user 1: status.find.in(200,201,202,203,204,205,206,207,208,209,304), found 429
================================================================================
2022-10-25 13:51:30 10s elapsed
---- Requests ------------------------------------------------------------------
> Global (OK=67 KO=345 )
> Create nodejs:default action (OK=0 KO=1 )
> Cold nodejs:default invocation (OK=1 KO=0 )
> Warm nodejs:default invocation (OK=59 KO=41 )
> Delete nodejs:default action (OK=1 KO=0 )
> Create python:default action (OK=1 KO=0 )
> Cold python:default invocation (OK=0 KO=1 )
> Warm python:default invocation (OK=0 KO=100 )
> Delete python:default action (OK=1 KO=0 )
> Create swift:default action (OK=1 KO=0 )
> Cold swift:default invocation (OK=0 KO=1 )
> Warm swift:default invocation (OK=0 KO=100 )
> Delete swift:default action (OK=1 KO=0 )
> Create java:default action (OK=1 KO=0 )
> Cold java:default invocation (OK=0 KO=1 )
> Warm java:default invocation (OK=0 KO=100 )
> Delete java:default action (OK=1 KO=0 )
---- Errors --------------------------------------------------------------------
> status.find.in(200,201,202,203,204,205,206,207,208,209,304), f 344 (99.71%)
ound 429
> status.find.in(200,201,202,203,204,205,206,207,208,209,304), f 1 ( 0.29%)
ound 409
---- Invoke one action after each other to test latency ------------------------
[##########################################################################]100%
waiting: 0 / active: 0 / done: 1
================================================================================
Simulation org.apache.openwhisk.LatencySimulation completed in 10 seconds
Parsing log file(s)...
Parsing log file(s) done
Generating reports...
================================================================================
---- Global Information --------------------------------------------------------
> request count 412 (OK=67 KO=345 )
> min response time 1 (OK=11 KO=1 )
> max response time 118 (OK=118 KO=74 )
> mean response time 6 (OK=24 KO=2 )
> std deviation 15 (OK=29 KO=4 )
> response time 50th percentile 2 (OK=13 KO=2 )
> response time 75th percentile 2 (OK=15 KO=2 )
> response time 95th percentile 14 (OK=100 KO=3 )
> response time 99th percentile 99 (OK=115 KO=4 )
> mean requests/sec 37.455 (OK=6.091 KO=31.364)
---- Response Time Distribution ------------------------------------------------
> t < 800 ms 67 ( 16%)
> 800 ms < t < 1200 ms 0 ( 0%)
> t > 1200 ms 0 ( 0%)
> failed 345 ( 84%)
---- Errors --------------------------------------------------------------------
> status.find.in(200,201,202,203,204,205,206,207,208,209,304), f 344 (99.71%)
ound 429
> status.find.in(200,201,202,203,204,205,206,207,208,209,304), f 1 ( 0.29%)
ound 409
================================================================================
Reports generated in 0s.
Please open the following file: /users/jinlang/openwhisk/tests/performance/gatling_tests/build/reports/gatling/latencysimulation-20221025195118978/index.html
Warm nodejs:default invocation: mean of response time is less than or equal to 10000.0 : true
Warm nodejs:default invocation: mean of response time is less than 10000.0 : true
Warm nodejs:default invocation: count of failed events is less than or equal to 0.0 : false
Warm nodejs:default invocation: percentage of failed events is less than or equal to 0.1 : false
Warm python:default invocation: mean of response time is less than or equal to 10000.0 : true
Warm python:default invocation: mean of response time is less than 10000.0 : true
Warm python:default invocation: count of failed events is less than or equal to 0.0 : false
Warm python:default invocation: percentage of failed events is less than or equal to 0.1 : false
Warm swift:default invocation: mean of response time is less than or equal to 10000.0 : true
Warm swift:default invocation: mean of response time is less than 10000.0 : true
Warm swift:default invocation: count of failed events is less than or equal to 0.0 : false
Warm swift:default invocation: percentage of failed events is less than or equal to 0.1 : false
Warm java:default invocation: mean of response time is less than or equal to 10000.0 : true
Warm java:default invocation: mean of response time is less than 10000.0 : true
Warm java:default invocation: count of failed events is less than or equal to 0.0 : false
Warm java:default invocation: percentage of failed events is less than or equal to 0.1 : false
> Task :tests:performance:gatling_tests:gatlingRun-org.apache.openwhisk.LatencySimulation FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':tests:performance:gatling_tests:gatlingRun-org.apache.openwhisk.LatencySimulation'.
> Some simulations failed : org.apache.openwhisk.LatencySimulation
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16s
4 actionable tasks: 2 executed, 2 up-to-date
```
Contributor guide
Assessment
This issue has not been assessed yet.