apache / apache/incubator-pegasus

`base_api_test` failed due to the failure of a replica server

Open
#2,283 1 comment 0 reactions 0 assignees View on GitHub
unit-test
Dominant language
C++
Stars
2.1k
Forks
328
PR merge metrics
No merged PRs in 30d

Description

`base_api_test` failed due to the failure of a replica server (get_alive_replica_server_count() returned 2), as following errors:

```
[ RUN ] integration_test.write_corrupt_db
create app temp succeed, waiting for app ready
temp is ready now: (8/8)
temp is ready now!
Pegasus project root: /__w/incubator-pegasus/incubator-pegasus
working dir: /__w/incubator-pegasus/incubator-pegasus/build/latest/bin/base_api_test
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:32:18.359 (1752579138359609562 3826) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:32:18.359 (1752579138359644738 3826) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:32:18.406 (1752579138406418015 3903) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:32:18.406 (1752579138406456066 3903) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 27 100 27 0 0 35904 0 --:--:-- --:--:-- --:--:-- 27000
W2025-07-15 11:32:19.318 (1752579139318739665 3765) mimic.io-thrd.3765: network.cpp:437:on_failure(): disconnect to remote 172.18.0.2:34801, the socket will be lazily closed when the session destroyed
E2025-07-15 11:32:23.493 (1752579143493696764 3803) mimic.default6.72073743115157579: partition_resolver.cpp:102:operator()(): service access failed (ERR_TIMEOUT), no more time for further tries, set error = ERR_TIMEOUT, trace_id = 0xa1cc5b5dbfe6187d
ok_count: 997, corruption_count: 4
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:32:24.215 (1752579144215479425 4041) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:32:24.215 (1752579144215506756 4041) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to c0536fe4882f port 34801 after 0 ms: Connection refused
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 72072 0 --:--:-- --:--:-- --:--:-- 56000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 82111 0 --:--:-- --:--:-- --:--:-- 56000
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:32:24.281 (1752579144281975462 4127) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:32:24.282 (1752579144282002873 4127) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to c0536fe4882f port 34801 after 0 ms: Connection refused
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 74468 0 --:--:-- --:--:-- --:--:-- 56000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 84592 0 --:--:-- --:--:-- --:--:-- 56000
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:32:24.347 (1752579144347407601 4213) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:32:24.347 (1752579144347436174 4213) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (7) Failed to connect to c0536fe4882f port 34801 after 0 ms: Connection refused
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 70796 0 --:--:-- --:--:-- --:--:-- 56000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 87636 0 --:--:-- --:--:-- --:--:-- 56000
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

......

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:33:22.176 (1752579202176894851 9697) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:33:22.176 (1752579202176926250 9697) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 80808 0 --:--:-- --:--:-- --:--:-- 56000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 89887 0 --:--:-- --:--:-- --:--:-- 56000
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:33:23.236 (1752579203236132342 9780) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:33:23.236 (1752579203236160444 9780) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 79207 0 --:--:-- --:--:-- --:--:-- 56000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 82962 0 --:--:-- --:--:-- --:--:-- 56000
Chosen stacktrace method is libgcc
Supported methods:
* generic_fp
* generic_fp_unsafe
* libgcc
* null

Use TCMALLOC_STACKTRACE_METHOD environment variable to override
W2025-07-15 11:33:24.296 (1752579204296660013 9863) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
W2025-07-15 11:33:24.296 (1752579204296689370 9863) : overwrite default thread pool for task RPC_CM_QUERY_PARTITION_CONFIG_BY_INDEX_ACK from THREAD_POOL_META_SERVER to THREAD_POOL_DEFAULT
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 77562 0 --:--:-- --:--:-- --:--:-- 56000
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed

0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 56 100 56 0 0 81632 0 --:--:-- --:--:-- --:--:-- 56000
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/base_api/integration_test.cpp:121: Failure
Expected equality of these values:
3
get_alive_replica_server_count()
Which is: 2

/__w/incubator-pegasus/incubator-pegasus/src/test_util/test_util.cpp:128: Failure
Failed
Timed out waiting for assertion to pass.

[ FAILED ] integration_test.write_corrupt_db (68009 ms)
[ RUN ] integration_test.read_corrupt_db
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
W2025-07-15 11:33:24.333 (1752579204333101364 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] integration_test.read_corrupt_db (6 ms)
[----------] 2 tests from integration_test (68015 ms total)

[----------] 8 tests from basic
[ RUN ] basic.set_get_del
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.set_get_del (1 ms)
[ RUN ] basic.multi_get
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.multi_get (1 ms)
[ RUN ] basic.multi_get_reverse
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.multi_get_reverse (1 ms)
[ RUN ] basic.multi_set_get_del
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.multi_set_get_del (1 ms)
[ RUN ] basic.set_get_del_async
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.set_get_del_async (1 ms)
[ RUN ] basic.multi_set_get_del_async
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.multi_set_get_del_async (1 ms)
[ RUN ] basic.scan_with_filter
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.scan_with_filter (1 ms)
[ RUN ] basic.full_scan_with_filter
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] basic.full_scan_with_filter (1 ms)
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
W2025-07-15 11:33:24.346 (1752579204346941977 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
[----------] 8 tests from basic (13 ms total)

[----------] 1 test from batch_get
[ RUN ] batch_get.set_and_then_batch_get
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
W2025-07-15 11:33:24.348 (1752579204348933832 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] batch_get.set_and_then_batch_get (1 ms)
[----------] 1 test from batch_get (1 ms total)

[----------] 12 tests from check_and_mutate
[ RUN ] check_and_mutate.value_not_exist
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_not_exist (1 ms)
[ RUN ] check_and_mutate.value_exist
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_exist (1 ms)
[ RUN ] check_and_mutate.value_not_empty
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_not_empty (1 ms)
[ RUN ] check_and_mutate.value_match_anywhere
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_match_anywhere (1 ms)
[ RUN ] check_and_mutate.value_match_prefix
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_match_prefix (1 ms)
[ RUN ] check_and_mutate.value_match_postfix
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_match_postfix (1 ms)
[ RUN ] check_and_mutate.value_bytes_compare
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_bytes_compare (1 ms)
[ RUN ] check_and_mutate.value_int_compare
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.value_int_compare (1 ms)
[ RUN ] check_and_mutate.invalid_type
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.invalid_type (1 ms)
[ RUN ] check_and_mutate.set_del
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.set_del (1 ms)
[ RUN ] check_and_mutate.multi_get_mutations
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.multi_get_mutations (1 ms)
[ RUN ] check_and_mutate.expire_seconds
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_mutate.expire_seconds (1 ms)
[----------] 12 tests from check_and_mutate (19 ms total)

[----------] 9 tests from check_and_set
[ RUN ] check_and_set.value_not_exist
W2025-07-15 11:33:24.368 (1752579204368447161 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_not_exist (1 ms)
[ RUN ] check_and_set.value_exist
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_exist (1 ms)
[ RUN ] check_and_set.value_not_empty
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_not_empty (1 ms)
[ RUN ] check_and_set.value_match_anywhere
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_match_anywhere (1 ms)
[ RUN ] check_and_set.value_match_prefix
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_match_prefix (1 ms)
[ RUN ] check_and_set.value_match_postfix
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_match_postfix (1 ms)
[ RUN ] check_and_set.value_bytes_compare
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_bytes_compare (1 ms)
[ RUN ] check_and_set.value_int_compare
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.value_int_compare (1 ms)
[ RUN ] check_and_set.invalid_type
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
W2025-07-15 11:33:24.383 (1752579204383092883 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] check_and_set.invalid_type (1 ms)
[----------] 9 tests from check_and_set (14 ms total)

[----------] 1 test from copy_data_test
[ RUN ] copy_data_test.EMPTY_HASH_KEY_COPY
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

W2025-07-15 11:33:24.385 (1752579204385506023 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
[ FAILED ] copy_data_test.EMPTY_HASH_KEY_COPY (2 ms)
[----------] 1 test from copy_data_test (2 ms total)

[----------] 3 tests from range_read_test
[ RUN ] range_read_test.multiget_test
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] range_read_test.multiget_test (1 ms)
[ RUN ] range_read_test.sortkeycount_test
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] range_read_test.sortkeycount_test (1 ms)
[ RUN ] range_read_test.scan_test
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
W2025-07-15 11:33:24.390 (1752579204390386936 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] range_read_test.scan_test (1 ms)
[----------] 3 tests from range_read_test (4 ms total)

[----------] 1 test from drop_and_recall
[ RUN ] drop_and_recall.simple
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] drop_and_recall.simple (1 ms)
[----------] 1 test from drop_and_recall (1 ms total)

[----------] 10 tests from scan_test
[ RUN ] scan_test.OVERALL_COUNT_ONLY
W2025-07-15 11:33:24.392 (1752579204392112303 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.OVERALL_COUNT_ONLY (2 ms)
[ RUN ] scan_test.ALL_SORT_KEY
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.ALL_SORT_KEY (1 ms)
[ RUN ] scan_test.BOUND_INCLUSIVE
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.BOUND_INCLUSIVE (2 ms)
[ RUN ] scan_test.BOUND_EXCLUSIVE
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.BOUND_EXCLUSIVE (2 ms)
[ RUN ] scan_test.ONE_POINT
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.ONE_POINT (1 ms)
[ RUN ] scan_test.HALF_INCLUSIVE
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.HALF_INCLUSIVE (1 ms)
[ RUN ] scan_test.VOID_SPAN
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.VOID_SPAN (2 ms)
[ RUN ] scan_test.OVERALL
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.OVERALL (2 ms)
[ RUN ] scan_test.REQUEST_EXPIRE_TS
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] scan_test.REQUEST_EXPIRE_TS (1 ms)
[ RUN ] scan_test.ITERATION_TIME_LIMIT
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

W2025-07-15 11:33:24.412 (1752579204412647711 3760) mimic.io-thrd.3760: pegasus_client_factory_impl.cpp:48:initialize(): rdsn engine already started, ignore the config file 'config.ini'
[ FAILED ] scan_test.ITERATION_TIME_LIMIT (1 ms)
[----------] 10 tests from scan_test (20 ms total)

[----------] 2 tests from ttl_test
[ RUN ] ttl_test.set_without_default_ttl
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] ttl_test.set_without_default_ttl (1 ms)
[ RUN ] ttl_test.set_with_default_ttl
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
ERR_INVALID_PARAMETERS: create app temp failed: [create] received server error
/__w/incubator-pegasus/incubator-pegasus/src/test/function_test/utils/test_util.cpp:93: Failure
Expected equality of these values:
dsn::ERR_OK
Which is: ERR_OK
ddl_client_->create_app(table_name_, "pegasus", partition_count_, 3, kCreateEnvs)
Which is: ERR_INVALID_PARAMETERS

[ FAILED ] ttl_test.set_with_default_ttl (1 ms)
[----------] 2 tests from ttl_test (3 ms total)

[----------] Global test environment tear-down
[==========] 49 tests from 10 test suites ran. (68099 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 49 tests, listed below:
[ FAILED ] integration_test.write_corrupt_db
[ FAILED ] integration_test.read_corrupt_db
[ FAILED ] basic.set_get_del
[ FAILED ] basic.multi_get
[ FAILED ] basic.multi_get_reverse
[ FAILED ] basic.multi_set_get_del
[ FAILED ] basic.set_get_del_async
[ FAILED ] basic.multi_set_get_del_async
[ FAILED ] basic.scan_with_filter
[ FAILED ] basic.full_scan_with_filter
[ FAILED ] batch_get.set_and_then_batch_get
[ FAILED ] check_and_mutate.value_not_exist
[ FAILED ] check_and_mutate.value_exist
[ FAILED ] check_and_mutate.value_not_empty
[ FAILED ] check_and_mutate.value_match_anywhere
[ FAILED ] check_and_mutate.value_match_prefix
[ FAILED ] check_and_mutate.value_match_postfix
[ FAILED ] check_and_mutate.value_bytes_compare
[ FAILED ] check_and_mutate.value_int_compare
[ FAILED ] check_and_mutate.invalid_type
[ FAILED ] check_and_mutate.set_del
[ FAILED ] check_and_mutate.multi_get_mutations
[ FAILED ] check_and_mutate.expire_seconds
[ FAILED ] check_and_set.value_not_exist
[ FAILED ] check_and_set.value_exist
[ FAILED ] check_and_set.value_not_empty
[ FAILED ] check_and_set.value_match_anywhere
[ FAILED ] check_and_set.value_match_prefix
[ FAILED ] check_and_set.value_match_postfix
[ FAILED ] check_and_set.value_bytes_compare
[ FAILED ] check_and_set.value_int_compare
[ FAILED ] check_and_set.invalid_type
[ FAILED ] copy_data_test.EMPTY_HASH_KEY_COPY
[ FAILED ] range_read_test.multiget_test
[ FAILED ] range_read_test.sortkeycount_test
[ FAILED ] range_read_test.scan_test
[ FAILED ] drop_and_recall.simple
[ FAILED ] scan_test.OVERALL_COUNT_ONLY
[ FAILED ] scan_test.ALL_SORT_KEY
[ FAILED ] scan_test.BOUND_INCLUSIVE
[ FAILED ] scan_test.BOUND_EXCLUSIVE
[ FAILED ] scan_test.ONE_POINT
[ FAILED ] scan_test.HALF_INCLUSIVE
[ FAILED ] scan_test.VOID_SPAN
[ FAILED ] scan_test.OVERALL
[ FAILED ] scan_test.REQUEST_EXPIRE_TS
[ FAILED ] scan_test.ITERATION_TIME_LIMIT
[ FAILED ] ttl_test.set_without_default_ttl
[ FAILED ] ttl_test.set_with_default_ttl

49 FAILED TESTS
dsn exit with code 1
```

Contributor guide

Open the contributing guide

Research direction

Start by running base_api_test and inspect src/test/function_test/base_api/integration_test.cpp:121, where get_alive_replica_server_count() is expected to be 3. Read the related test utilities at src/test_util/test_util.cpp:128 and src/test/function_test/utils/test_util.cpp:93. Done means the replica failure no longer causes these integration tests and subsequent app creation to fail.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.