[C++][Python][FlightRPC] Crash in PyArrow Flight test_never_sends_data test from GRPC
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
### Describe the bug, including details regarding any error messages, version, and platform.
I've been able to reproduce a Flight test crash on two machines so I'm reporting it.
- The machines are both macOS aarch64
- The crash happens during RC verification (21.0.0 RC6) _and_ when running tests against latest `main`
- Others didn't reproduce during RC verification
- The crash happens in both release mode and debug mode
- My grpc version is from brew, `1.73.1`
The Python stack trace is,
```
Fatal Python error: Aborted
Current thread 0x0000000204bd5f00 (most recent call first):
File "/Users/bryce/src/apache/arrow/python/pyarrow/tests/test_flight.py", line 2299 in test_never_sends_data
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/python.py", line 157 in pytest_pyfunc_call
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/python.py", line 1671 in runtest
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/runner.py", line 178 in pytest_runtest_call
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/runner.py", line 246 in
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/runner.py", line 344 in from_call
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/runner.py", line 245 in call_and_report
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/runner.py", line 136 in runtestprotocol
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/runner.py", line 117 in pytest_runtest_protocol
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/main.py", line 367 in pytest_runtestloop
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/main.py", line 343 in _main
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/main.py", line 289 in wrap_session
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/main.py", line 336 in pytest_cmdline_main
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/config/__init__.py", line 175 in main
File "/Users/bryce/src/apache/arrow/python/.venv/lib/python3.13/site-packages/_pytest/config/__init__.py", line 201 in console_main
File "/Users/bryce/src/apache/arrow/python/.venv/bin/pytest", line 10 in
```
Detailed stack trace below:
debug mode stack trace
```
(lldb) thread backtrace all
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
* frame #0: 0x0000000196a8d388 libsystem_kernel.dylib`__pthread_kill + 8
frame #1: 0x0000000196ac688c libsystem_pthread.dylib`pthread_kill + 296
frame #2: 0x00000001969cfc60 libsystem_c.dylib`abort + 124
frame #3: 0x00000001071020a8 libabsl_log_internal_message.2407.0.0.dylib`absl::lts_20240722::log_internal::LogMessage::FailWithoutStackTrace() + 20
frame #4: 0x0000000107102580 libabsl_log_internal_message.2407.0.0.dylib`absl::lts_20240722::log_internal::LogMessage::Die() + 44
frame #5: 0x0000000107102264 libabsl_log_internal_message.2407.0.0.dylib`absl::lts_20240722::log_internal::LogMessage::SendToLog() + 128
frame #6: 0x0000000107101d14 libabsl_log_internal_message.2407.0.0.dylib`absl::lts_20240722::log_internal::LogMessage::Flush() + 336
frame #7: 0x00000001071025bc libabsl_log_internal_message.2407.0.0.dylib`absl::lts_20240722::log_internal::LogMessageFatal::~LogMessageFatal() + 12
frame #8: 0x00000001071025d4 libabsl_log_internal_message.2407.0.0.dylib`absl::lts_20240722::log_internal::LogMessageFatal::~LogMessageFatal() + 12
frame #9: 0x0000000115169198 libarrow_flight.2100.0.0.dylib`grpc::internal::CallOpSet, grpc::internal::CallNoOp<3>, grpc::internal::CallNoOp<4>, grpc::internal::CallNoOp<5>, grpc::internal::CallNoOp<6>>::ContinueFillOpsAfterInterception(this=0x000000016b56c570) at call_op_set.h:981:7
frame #10: 0x0000000115127e80 libarrow_flight.2100.0.0.dylib`grpc::internal::InterceptorBatchMethodsImpl::ProceedClient(this=0x000000016b56c5f0) at interceptor_common.h:326:15
frame #11: 0x0000000115126f60 libarrow_flight.2100.0.0.dylib`grpc::internal::InterceptorBatchMethodsImpl::Proceed(this=0x000000016b56c5f0) at interceptor_common.h:58:14
frame #12: 0x000000011511d0ac libarrow_flight.2100.0.0.dylib`arrow::flight::transport::grpc::(anonymous namespace)::GrpcClientInterceptorAdapter::Intercept(this=0x00006000005b7a20, methods=0x000000016b56c5f0) at grpc_client.cc:144:14
frame #13: 0x00000001151282b0 libarrow_flight.2100.0.0.dylib`grpc::experimental::ClientRpcInfo::RunInterceptor(this=0x000000011f605360, interceptor_methods=0x000000016b56c5f0, pos=0) at client_interceptor.h:144:25
frame #14: 0x000000011512a568 libarrow_flight.2100.0.0.dylib`grpc::internal::InterceptorBatchMethodsImpl::RunClientInterceptors(this=0x000000016b56c5f0) at interceptor_common.h:288:15
frame #15: 0x000000011512a428 libarrow_flight.2100.0.0.dylib`grpc::internal::InterceptorBatchMethodsImpl::RunInterceptors(this=0x000000016b56c5f0) at interceptor_common.h:246:9
frame #16: 0x000000011516966c libarrow_flight.2100.0.0.dylib`grpc::internal::CallOpSet, grpc::internal::CallNoOp<3>, grpc::internal::CallNoOp<4>, grpc::internal::CallNoOp<5>, grpc::internal::CallNoOp<6>>::RunInterceptors(this=0x000000016b56c570) at call_op_set.h:1013:33
frame #17: 0x0000000115168ee0 libarrow_flight.2100.0.0.dylib`grpc::internal::CallOpSet, grpc::internal::CallNoOp<3>, grpc::internal::CallNoOp<4>, grpc::internal::CallNoOp<5>, grpc::internal::CallNoOp<6>>::FillOps(this=0x000000016b56c570, call=0x00006000037900e8) at call_op_set.h:901:9
frame #18: 0x00000001151263d4 libarrow_flight.2100.0.0.dylib`grpc::internal::Call::PerformOps(this=0x00006000037900e8, ops=0x000000016b56c570) at call.h:67:17
frame #19: 0x000000011515fd78 libarrow_flight.2100.0.0.dylib`grpc::ClientReader::Read(this=0x0000600003790090, msg=0x000000016b56c858) at sync_stream.h:215:11
frame #20: 0x000000011515fcc4 libarrow_flight.2100.0.0.dylib`arrow::flight::transport::grpc::ReadPayload(reader=0x0000600003790090, data=0x000000016b56c858) at serialization_internal.cc:454:18
frame #21: 0x0000000115142180 libarrow_flight.2100.0.0.dylib`arrow::flight::transport::grpc::(anonymous namespace)::FinishableDataStream, arrow::flight::internal::FlightData>::DoFinish(this=0x00006000010e8400) at grpc_client.cc:282:12
frame #22: 0x00000001150fc3bc libarrow_flight.2100.0.0.dylib`arrow::flight::internal::ClientDataStream::Finish(this=0x00006000010e8400, st=Status @ 0x000000016b56c990) at transport.cc:47:24
frame #23: 0x00000001150b06a0 libarrow_flight.2100.0.0.dylib`arrow::flight::ClientStreamReader::OverrideWithServerError(this=0x0000600003094180, st=0x000000016b56cad0) at client.cc:273:21
frame #24: 0x00000001150a95b8 libarrow_flight.2100.0.0.dylib`arrow::flight::ClientStreamReader::EnsureDataStarted(this=0x0000600003094180) at client.cc:196:16
frame #25: 0x00000001150a9154 libarrow_flight.2100.0.0.dylib`arrow::flight::FlightClient::DoGet(this=0x00006000005e4020, options=0x000000011460abb8, ticket=0x0000000114fa7c48) at client.cc:678:3
frame #26: 0x000000011453ca58 _flight.cpython-313-darwin.so`__pyx_pf_7pyarrow_7_flight_12FlightClient_23do_get(__pyx_v_self=0x0000000114fa7cc0, __pyx_v_ticket=0x0000000114fa7c30, __pyx_v_options=0x00000001053e6338) at _flight.cpp:44261:95
frame #27: 0x000000011452f6e0 _flight.cpython-313-darwin.so`__pyx_pw_7pyarrow_7_flight_12FlightClient_24do_get(__pyx_v_self=0x0000000114fa7cc0, __pyx_args=0x0000000104a01598, __pyx_nargs=1, __pyx_kwds=0x0000000000000000) at _flight.cpp:44194:13
frame #28: 0x00000001145acda0 _flight.cpython-313-darwin.so`__Pyx_CyFunction_Vectorcall_FASTCALL_KEYWORDS(func=0x000000010fa2c640, args=0x0000000104a01598, nargsf=9223372036854775810, kwnames=0x0000000000000000) at _flight.cpp:97101:12
frame #29: 0x0000000105054360 Python`PyObject_Vectorcall + 92
frame #30: 0x000000010517cdb0 Python`_PyEval_EvalFrameDefault + 6860
frame #31: 0x0000000105053674 Python`_PyObject_VectorcallDictTstate + 200
frame #32: 0x0000000105054bd8 Python`_PyObject_Call_Prepend + 136
frame #33: 0x00000001050e55ec Python`slot_tp_call + 128
frame #34: 0x00000001050537fc Python`_PyObject_MakeTpCall + 120
frame #35: 0x0000000105182934 Python`_PyEval_EvalFrameDefault + 30288
frame #36: 0x0000000105053674 Python`_PyObject_VectorcallDictTstate + 200
frame #37: 0x0000000105054bd8 Python`_PyObject_Call_Prepend + 136
frame #38: 0x00000001050e55ec Python`slot_tp_call + 128
frame #39: 0x00000001050544dc Python`_PyObject_Call + 128
frame #40: 0x0000000105180984 Python`_PyEval_EvalFrameDefault + 22176
frame #41: 0x0000000105053674 Python`_PyObject_VectorcallDictTstate + 200
frame #42: 0x0000000105054bd8 Python`_PyObject_Call_Prepend + 136
frame #43: 0x00000001050e55ec Python`slot_tp_call + 128
frame #44: 0x00000001050537fc Python`_PyObject_MakeTpCall + 120
frame #45: 0x0000000105182934 Python`_PyEval_EvalFrameDefault + 30288
frame #46: 0x0000000105053674 Python`_PyObject_VectorcallDictTstate + 200
frame #47: 0x0000000105054bd8 Python`_PyObject_Call_Prepend + 136
frame #48: 0x00000001050e55ec Python`slot_tp_call + 128
frame #49: 0x00000001050537fc Python`_PyObject_MakeTpCall + 120
frame #50: 0x0000000105182934 Python`_PyEval_EvalFrameDefault + 30288
frame #51: 0x0000000105053674 Python`_PyObject_VectorcallDictTstate + 200
frame #52: 0x0000000105054bd8 Python`_PyObject_Call_Prepend + 136
frame #53: 0x00000001050e55ec Python`slot_tp_call + 128
frame #54: 0x00000001050537fc Python`_PyObject_MakeTpCall + 120
frame #55: 0x0000000105182934 Python`_PyEval_EvalFrameDefault + 30288
frame #56: 0x000000010517b068 Python`PyEval_EvalCode + 200
frame #57: 0x00000001051eb9f8 Python`run_eval_code_obj + 104
frame #58: 0x00000001051eb440 Python`run_mod + 168
frame #59: 0x00000001051e9ae8 Python`pyrun_file + 164
frame #60: 0x00000001051e8e24 Python`_PyRun_SimpleFileObject + 256
frame #61: 0x00000001051e8a5c Python`_PyRun_AnyFileObject + 80
frame #62: 0x00000001052106f8 Python`pymain_run_file_obj + 164
frame #63: 0x00000001052103a4 Python`pymain_run_file + 76
frame #64: 0x000000010520f614 Python`Py_RunMain + 968
frame #65: 0x000000010520fc10 Python`pymain_main + 304
frame #66: 0x000000010520fcb0 Python`Py_BytesMain + 40
frame #67: 0x0000000196726b98 dyld`start + 6076
thread #2
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x000000010fc3d0a0 libgpr.48.0.0.dylib`gpr_cv_wait + 228
frame #7: 0x0000000116484974 libgrpc.48.0.0.dylib`timer_thread(void*) + 512
frame #8: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #9: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #3
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x000000011645fb88 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::TimerManager::WaitUntil(grpc_core::Timestamp) + 280
frame #7: 0x000000011646050c libgrpc.48.0.0.dylib`void absl::lts_20240722::internal_any_invocable::RemoteInvoker(absl::lts_20240722::internal_any_invocable::TypeErasedState*) + 40
frame #8: 0x0000000116465314 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::SelfDeletingClosure::Run() + 28
frame #9: 0x0000000116465054 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 120
frame #10: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #11: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #12: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #13: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #4
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #5
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #6
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #7
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #8
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #9
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #10
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #11
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #12
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #13
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #14
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #15
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164648bc libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout(grpc_core::Duration) + 128
frame #7: 0x00000001164650f8 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 284
frame #8: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #9: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #10: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #11: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #16
frame #0: 0x0000000196a8d498 libsystem_kernel.dylib`poll + 8
frame #1: 0x000000011644a57c libgrpc.48.0.0.dylib`grpc_event_engine::experimental::PollPoller::Work(std::__1::chrono::duration>, absl::lts_20240722::FunctionRef) + 400
frame #2: 0x000000011645348c libgrpc.48.0.0.dylib`grpc_event_engine::experimental::PosixEventEngine::PollerWorkInternal(std::__1::shared_ptr) + 76
frame #3: 0x0000000116456690 libgrpc.48.0.0.dylib`void absl::lts_20240722::internal_any_invocable::LocalInvoker)::$_0::operator()() const::'lambda'()&>(absl::lts_20240722::internal_any_invocable::TypeErasedState*) + 36
frame #4: 0x0000000116465314 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::SelfDeletingClosure::Run() + 28
frame #5: 0x0000000116465054 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step() + 120
frame #6: 0x0000000116464d78 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody() + 152
frame #7: 0x0000000116465534 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::StartThread()::$_0::__invoke(void*) + 20
frame #8: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #9: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #17
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac710c libsystem_pthread.dylib`_pthread_cond_wait + 1028
frame #2: 0x0000000105fcbdfc libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::TimedWait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 84
frame #3: 0x0000000105fcbe5c libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::synchronization_internal::PthreadWaiter::Wait(absl::lts_20240722::synchronization_internal::KernelTimeout) + 80
frame #4: 0x0000000105fcbd2c libabsl_synchronization.2407.0.0.dylib`AbslInternalPerThreadSemWait_lts_20240722 + 76
frame #5: 0x0000000105fcec58 libabsl_synchronization.2407.0.0.dylib`absl::lts_20240722::CondVar::WaitCommon(absl::lts_20240722::Mutex*, absl::lts_20240722::synchronization_internal::KernelTimeout) + 184
frame #6: 0x00000001164649cc libgrpc.48.0.0.dylib`grpc_core::Notification::WaitForNotificationWithTimeout(absl::lts_20240722::Duration) + 212
frame #7: 0x0000000116464640 libgrpc.48.0.0.dylib`grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::Lifeguard::LifeguardMain() + 196
frame #8: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #9: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #18
frame #0: 0x0000000196a857dc libsystem_kernel.dylib`read + 8
frame #1: 0x000000011adb71a4 libarrow.2100.0.0.dylib`arrow::internal::(anonymous namespace)::SelfPipeImpl::Wait(this=0x0000600002681558) at io_util.cc:1282:24
frame #2: 0x000000011ad5f068 libarrow.2100.0.0.dylib`arrow::(anonymous namespace)::SignalStopState::ReceiveSignals(self_pipe=std::__1::shared_ptr::element_type @ 0x0000600002681558 strong=2 weak=3) at cancel.cc:246:39
frame #4: 0x000000011ad5fcb0 libarrow.2100.0.0.dylib`void std::__1::__thread_execute[abi:ne190102]>, void (*)(std::__1::shared_ptr), std::__1::shared_ptr, 2ul>(__t=size=3, (null)=__tuple_indices<2UL> @ 0x000000016d20af7f) at thread.h:198:3
frame #5: 0x000000011ad5f50c libarrow.2100.0.0.dylib`void* std::__1::__thread_proxy[abi:ne190102]>, void (*)(std::__1::shared_ptr), std::__1::shared_ptr>>(__vp=0x000060000058f800) at thread.h:207:3
frame #6: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #19
frame #0: 0x0000000196a868b0 libsystem_kernel.dylib`__workq_kernreturn + 8
thread #20
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac70e0 libsystem_pthread.dylib`_pthread_cond_wait + 984
frame #2: 0x00000001969f7298 libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock&) + 32
frame #3: 0x000000011adf2d30 libarrow.2100.0.0.dylib`arrow::internal::WorkerLoop(state=std::__1::shared_ptr::element_type @ 0x000000015ae49208 strong=3 weak=2, it=std::__1::list >::iterator @ 0x000000016d66aed8) at thread_pool.cc:501:16
frame #4: 0x000000011adf28e0 libarrow.2100.0.0.dylib`arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_0::operator()(this=0x0000600000ba6d98) const at thread_pool.cc:645:7
frame #6: 0x000000011adf2830 libarrow.2100.0.0.dylib`void std::__1::__thread_execute[abi:ne190102]>, arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_0>(__t=size=2, (null)=__tuple_indices<> @ 0x000000016d66af7f) at thread.h:198:3
frame #7: 0x000000011adf24a8 libarrow.2100.0.0.dylib`void* std::__1::__thread_proxy[abi:ne190102]>, arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_0>>(__vp=0x0000600000ba6d90) at thread.h:207:3
frame #8: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #21
frame #0: 0x0000000196a8d498 libsystem_kernel.dylib`poll + 8
frame #1: 0x000000011646d59c libgrpc.48.0.0.dylib`pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) + 1264
frame #2: 0x00000001164a4d70 libgrpc.48.0.0.dylib`cq_next(grpc_completion_queue*, gpr_timespec, void*) + 364
frame #3: 0x000000010fd1e270 libgrpc++.1.73.1.dylib`grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) + 60
frame #4: 0x000000010fd369c4 libgrpc++.1.73.1.dylib`grpc::Server::SyncRequestThreadManager::PollForWork(void**, bool*) + 108
frame #5: 0x000000010fd3dbec libgrpc++.1.73.1.dylib`grpc::ThreadManager::MainWorkLoop() + 56
frame #6: 0x000000010fd3e338 libgrpc++.1.73.1.dylib`grpc::ThreadManager::WorkerThread::WorkerThread(grpc::ThreadManager*)::$_0::__invoke(void*) + 24
frame #7: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #8: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #22
frame #0: 0x0000000196a883cc libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x0000000196ac70e0 libsystem_pthread.dylib`_pthread_cond_wait + 984
frame #2: 0x00000001969f7298 libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock&) + 32
frame #3: 0x0000000115121664 libarrow_flight.2100.0.0.dylib`void std::__1::condition_variable::wait(this=0x0000600003e94068, __lk=0x000000016b682f28, __pred=(unnamed class) @ 0x000000016b682ee8) at condition_variable.h:147:5
frame #4: 0x0000000115121574 libarrow_flight.2100.0.0.dylib`arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin(this=0x000060000079c108)::'lambda'()::operator()() const at grpc_client.cc:592:29
frame #6: 0x00000001151214d0 libarrow_flight.2100.0.0.dylib`void std::__1::__thread_execute[abi:ne190102]>, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::'lambda'()>(__t=size=2, (null)=__tuple_indices<> @ 0x000000016b682f7f) at thread.h:198:3
frame #7: 0x00000001151211e0 libarrow_flight.2100.0.0.dylib`void* std::__1::__thread_proxy[abi:ne190102]>, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::'lambda'()>>(__vp=0x000060000079c100) at thread.h:207:3
frame #8: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
thread #23
frame #0: 0x0000000196a8d498 libsystem_kernel.dylib`poll + 8
frame #1: 0x000000011646d59c libgrpc.48.0.0.dylib`pollset_work(grpc_pollset*, grpc_pollset_worker**, grpc_core::Timestamp) + 1264
frame #2: 0x00000001164a4d70 libgrpc.48.0.0.dylib`cq_next(grpc_completion_queue*, gpr_timespec, void*) + 364
frame #3: 0x000000010fd1e270 libgrpc++.1.73.1.dylib`grpc::CompletionQueue::AsyncNextInternal(void**, bool*, gpr_timespec) + 60
frame #4: 0x000000010fd369c4 libgrpc++.1.73.1.dylib`grpc::Server::SyncRequestThreadManager::PollForWork(void**, bool*) + 108
frame #5: 0x000000010fd3dbec libgrpc++.1.73.1.dylib`grpc::ThreadManager::MainWorkLoop() + 56
frame #6: 0x000000010fd3e338 libgrpc++.1.73.1.dylib`grpc::ThreadManager::WorkerThread::WorkerThread(grpc::ThreadManager*)::$_0::__invoke(void*) + 24
frame #7: 0x000000010fc3be58 libgpr.48.0.0.dylib`grpc_core::(anonymous namespace)::ThreadInternalsPosix::ThreadInternalsPosix(char const*, void (*)(void*), void*, bool*, grpc_core::Thread::Options const&)::'lambda'(void*)::__invoke(void*) + 132
frame #8: 0x0000000196ac6c0c libsystem_pthread.dylib`_pthread_start + 136
```
### Component(s)
FlightRPC, C++, Python
Contributor guide
Assessment
This issue has not been assessed yet.