key4hep / key4hep/k4MarlinWrapper
The test `clicRec_lcio_mt` can fail
- Dominant language
- Python
- Stars
- 3
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Description
### Check duplicate issues.
- [x] Checked for duplicates
### Goal
It seems there is a probability this test fails, see https://github.com/key4hep/k4FWCore/actions/runs/18032694192/job/51572070472 (probably valid only for one month). This is the stack trace:
``` cpp
2025-09-30T08:19:54.3097464Z [ DEBUG4 "k4MarlinWrapper"] Cov matrix: +4.160360e-04
2025-09-30T08:19:54.3097613Z [ DEBUG4 "k4MarlinWrapper"] -1.272802e-05, +3.944519e-07
2025-09-30T08:19:54.3097681Z [ DEBUG4 "
2025-09-30T08:19:54.3097778Z
2025-09-30T08:19:54.3097781Z
2025-09-30T08:19:54.3097871Z ===========================================================
2025-09-30T08:19:54.3097944Z There was a crash.
2025-09-30T08:19:54.3098052Z This is the entire stack trace of all threads:
2025-09-30T08:19:54.3098132Z ===========================================================
2025-09-30T08:19:54.3098136Z
2025-09-30T08:19:54.3098309Z Thread 9 (Thread 0x7f7a419ff640 (LWP 2413) "python"):
2025-09-30T08:19:54.3098485Z #0 0x00007f7a5ec2470d in syscall () from /lib64/libc.so.6
2025-09-30T08:19:54.3099373Z #1 0x00007f7a5db12bad in tbb::detail::r1::wait_bounded_queue_monitor(tbb::detail::r1::concurrent_monitor*, unsigned long, long, tbb::detail::d1::delegate_base&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3099916Z #2 0x00007f7a59fd5b21 in InertMessageSvc::m_activate() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiCoreSvc.so
2025-09-30T08:19:54.3100337Z #3 0x00007f7a5ccff764 in execute_native_thread_routine () from /cvmfs/sw.hsf.org/contrib/x86_64-almalinux9-gcc11.4.1-opt/gcc/14.2.0-yuyjov/lib64/libstdc++.so.6
2025-09-30T08:19:54.3100483Z #4 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3100602Z #5 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3100606Z
2025-09-30T08:19:54.3100719Z Thread 8 (Thread 0x7f7a3a71d640 (LWP 2414) "python"):
2025-09-30T08:19:54.3100839Z #0 0x00007f7a5ec2470d in syscall () from /lib64/libc.so.6
2025-09-30T08:19:54.3101641Z #1 0x00007f7a5db12bad in tbb::detail::r1::wait_bounded_queue_monitor(tbb::detail::r1::concurrent_monitor*, unsigned long, long, tbb::detail::d1::delegate_base&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3102178Z #2 0x00007f7a406df3e2 in AvalancheSchedulerSvc::activate() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3102724Z #3 0x00007f7a5ccff764 in execute_native_thread_routine () from /cvmfs/sw.hsf.org/contrib/x86_64-almalinux9-gcc11.4.1-opt/gcc/14.2.0-yuyjov/lib64/libstdc++.so.6
2025-09-30T08:19:54.3102863Z #4 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3102981Z #5 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3102984Z
2025-09-30T08:19:54.3103091Z Thread 7 (Thread 0x7f7a3971c640 (LWP 2415) "python"):
2025-09-30T08:19:54.3103269Z #0 0x00007f7a5eba422a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2025-09-30T08:19:54.3103366Z #1 0x00007f7a5eba6782 in pthread_cond_wait
2025-09-30T08:19:54.3103374Z
2025-09-30T08:19:54.3103456Z GLIBC_2.3.2 () from /lib64/libc.so.6
2025-09-30T08:19:54.3104385Z #2 0x00007f7a5dc1168b in boost::fibers::algo::shared_work::suspend_until(std::chrono::time_point > > const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3104961Z #3 0x00007f7a5dc1810a in boost::fibers::scheduler::dispatch() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3105607Z #4 0x00007f7a5dc15d4d in boost::fibers::dispatcher_context::run_(boost::context::fiber&&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3106996Z #5 0x00007f7a5dc15dab in void boost::context::detail::fiber_entry))(boost::context::fiber&&)> > >(boost::context::detail::transfer_t) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3107572Z #6 0x00007f7a5daf817f in make_fcontext () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_context.so.1.88.0
2025-09-30T08:19:54.3107743Z #7 0x0000000000000000 in ?? ()
2025-09-30T08:19:54.3107748Z
2025-09-30T08:19:54.3107860Z Thread 6 (Thread 0x7f7a33fff640 (LWP 2416) "python"):
2025-09-30T08:19:54.3108046Z #0 0x00007f7a5eba422a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2025-09-30T08:19:54.3108181Z #1 0x00007f7a5eba6782 in pthread_cond_wait
2025-09-30T08:19:54.3108186Z
2025-09-30T08:19:54.3108264Z GLIBC_2.3.2 () from /lib64/libc.so.6
2025-09-30T08:19:54.3109184Z #2 0x00007f7a5dc1168b in boost::fibers::algo::shared_work::suspend_until(std::chrono::time_point > > const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3109751Z #3 0x00007f7a5dc1810a in boost::fibers::scheduler::dispatch() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3110388Z #4 0x00007f7a5dc15d4d in boost::fibers::dispatcher_context::run_(boost::context::fiber&&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3111768Z #5 0x00007f7a5dc15dab in void boost::context::detail::fiber_entry))(boost::context::fiber&&)> > >(boost::context::detail::transfer_t) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_fiber.so.1.88.0
2025-09-30T08:19:54.3112276Z #6 0x00007f7a5daf817f in make_fcontext () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/boost/1.88.0-pfej4w/lib/libboost_context.so.1.88.0
2025-09-30T08:19:54.3112350Z #7 0x0000000000000000 in ?? ()
2025-09-30T08:19:54.3112354Z
2025-09-30T08:19:54.3112462Z Thread 5 (Thread 0x7f7a175fe640 (LWP 2432) "python"):
2025-09-30T08:19:54.3113599Z #0 0x00007f7a44b5d858 in aidaTT::intersectWithZPlane(dd4hep::rec::ISurface const*, aidaTT::Vector5 const&, dd4hep::rec::Vector3D const&, double&, dd4hep::rec::Vector3D&, int, bool) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/aidatt/07400e85877c6610d728cf5943a349301b17ca2b_develop-ecqwfl/lib/libaidaTT.so.0.10
2025-09-30T08:19:54.3114544Z #1 0x00007f7a4816cde4 in DDParallelPlanarMeasLayer::CalcXingPointWith(TVTrack const&, TVector3&, double&, int, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/ddkaltest/9af3dfe9ee92799d78e09c68fda6991fede0af08_develop-nxaehx/lib/libDDKalTest.so.1.7
2025-09-30T08:19:54.3115442Z #2 0x00007f7a31090687 in MarlinTrk::MarlinDDKalTest::getLastMeasLayer(THelicalTrack const&, TVector3 const&) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3116521Z #3 0x00007f7a3109b3ee in MarlinTrk::MarlinDDKalTestTrack::propagate(dd4hep::rec::Vector3D const&, TKalTrackSite const&, IMPL::TrackStateImpl&, double&, int&, DDVMeasLayer const*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3117581Z #4 0x00007f7a3109c28a in MarlinTrk::MarlinDDKalTestTrack::propagate(dd4hep::rec::Vector3D const&, EVENT::TrackerHit*, IMPL::TrackStateImpl&, double&, int&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3118927Z #5 0x00007f7a310ab225 in MarlinTrk::finaliseLCIOTrack(MarlinTrk::IMarlinTrack*, IMPL::TrackImpl*, std::vector >&, bool, IMPL::TrackStateImpl*, IMPL::TrackStateImpl*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3120177Z #6 0x00007f7a310acda6 in MarlinTrk::createFinalisedLCIOTrack(MarlinTrk::IMarlinTrack*, std::vector >&, IMPL::TrackImpl*, bool, std::vector > const&, float, double) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3121029Z #7 0x00007f7a283c59fc in ConformalTracking::processEvent(EVENT::LCEvent*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/conformaltracking/38a152b9d2c01c744182a01f286d88021b188af4_develop-itzn62/lib/libConformalTracking.so.1.12.0
2025-09-30T08:19:54.3121524Z #8 0x00007f7a32beda5c in MarlinProcessorWrapper::execute (this=0xecaea80) at /Workarea/03_k4marlinwrapper/k4MarlinWrapper/src/components/MarlinProcessorWrapper.cpp:274
2025-09-30T08:19:54.3122110Z #9 0x00007f7a5d7ce49d in Gaudi::Algorithm::sysExecute(EventContext const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiKernel.so
2025-09-30T08:19:54.3122767Z #10 0x00007f7a406d4a0f in AlgTask::operator()() const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3123443Z #11 0x00007f7a406fcac3 in tbb::detail::d1::enqueue_task::execute(tbb::detail::d1::execution_data&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3124033Z #12 0x00007f7a5db2d602 in tbb::detail::r1::thread_dispatcher::process(rml::job&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3124632Z #13 0x00007f7a5db277cd in tbb::detail::r1::rml::private_worker::thread_routine(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3124773Z #14 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3124893Z #15 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3124898Z
2025-09-30T08:19:54.3125008Z Thread 4 (Thread 0x7f7a171fd640 (LWP 2433) "python"):
2025-09-30T08:19:54.3125890Z #0 0x00007f7a1958a610 in ROOT::Minuit2::FunctionGradient::FunctionGradient(ROOT::Minuit2::LAVector const&, ROOT::Minuit2::LAVector const&, ROOT::Minuit2::LAVector const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3127017Z #1 0x00007f7a195ba4c4 in ROOT::Minuit2::(anonymous namespace)::ComputeNumerical(ROOT::Minuit2::MnFcn const&, ROOT::Minuit2::MinimumState const&, ROOT::Minuit2::MnUserTransformation const&, unsigned int, ROOT::Minuit2::MnStrategy const&) [clone .lto_priv.0] () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3128000Z #2 0x00007f7a195afcf1 in ROOT::Minuit2::MnHesse::operator()(ROOT::Minuit2::MnFcn const&, ROOT::Minuit2::MinimumState const&, ROOT::Minuit2::MnUserTransformation const&, unsigned int) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3129213Z #3 0x00007f7a195d8600 in ROOT::Minuit2::VariableMetricBuilder::Minimum(ROOT::Minuit2::MnFcn const&, ROOT::Minuit2::GradientCalculator const&, ROOT::Minuit2::MinimumSeed const&, ROOT::Minuit2::MnStrategy const&, unsigned int, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3130290Z #4 0x00007f7a195c7610 in ROOT::Minuit2::ModularFunctionMinimizer::Minimize(ROOT::Minuit2::MnFcn const&, ROOT::Minuit2::GradientCalculator const&, ROOT::Minuit2::MinimumSeed const&, ROOT::Minuit2::MnStrategy const&, unsigned int, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3131292Z #5 0x00007f7a195c6c29 in ROOT::Minuit2::ModularFunctionMinimizer::Minimize(ROOT::Minuit2::FCNBase const&, ROOT::Minuit2::MnUserParameterState const&, ROOT::Minuit2::MnStrategy const&, unsigned int, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3131881Z #6 0x00007f7a195a3eca in ROOT::Minuit2::Minuit2Minimizer::Minimize() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3132903Z #7 0x00007f7a19176e52 in lcfiplus::Helix::LogLikelihood(TVector3 const&, double&) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3133696Z #8 0x00007f7a1917b9fe in lcfiplus::Helix::LogLikelihood(TVector3 const&) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3134710Z #9 0x00007f7a1917a5e1 in std::_Function_handler::_M_invoke(std::_Any_data const&, double const*&&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3135493Z #10 0x00007f7a28048f6f in std::function::operator() (this=, __args#0=) at /cvmfs/sw.hsf.org/contrib/x86_64-almalinux9-gcc11.4.1-opt/gcc/14.2.0-yuyjov/lib/gcc/x86_64-pc-linux-gnu/14.2.0/../../../../include/c++/14.2.0/bits/std_function.h:591
2025-09-30T08:19:54.3136075Z #11 ROOT::Math::Functor::DoEval (this=, x=) at /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/include/root/Math/Functor.h:75
2025-09-30T08:19:54.3136985Z #12 0x00007f7a195c9253 in ROOT::Minuit2::Numerical2PGradientCalculator::operator()(ROOT::Minuit2::MinimumParameters const&, ROOT::Minuit2::FunctionGradient const&) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3137770Z #13 0x00007f7a195c4af7 in ROOT::Minuit2::Numerical2PGradientCalculator::operator()(ROOT::Minuit2::MinimumParameters const&) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3138868Z #14 0x00007f7a195c258e in ROOT::Minuit2::MnSeedGenerator::operator()(ROOT::Minuit2::MnFcn const&, ROOT::Minuit2::GradientCalculator const&, ROOT::Minuit2::MnUserParameterState const&, ROOT::Minuit2::MnStrategy const&) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3140021Z #15 0x00007f7a195c6c01 in ROOT::Minuit2::ModularFunctionMinimizer::Minimize(ROOT::Minuit2::FCNBase const&, ROOT::Minuit2::MnUserParameterState const&, ROOT::Minuit2::MnStrategy const&, unsigned int, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libMinuit2.so.6.36
2025-09-30T08:19:54.3141091Z #16 0x00007f7a19174645 in lcfiplus::GeometryHandler::PointFit(std::vector > const&, TVector3 const&, lcfiplus::Point*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3143197Z #17 0x00007f7a1914253e in lcfiplus::VertexFitterSimple<__gnu_cxx::__normal_iterator > > >::operator()(__gnu_cxx::__normal_iterator > >, __gnu_cxx::__normal_iterator > >, lcfiplus::Vertex*, bool) [clone .isra.0] () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3144426Z #18 0x00007f7a191478a2 in lcfiplus::VertexFinderSuehara::associateIPTracks(std::vector >&, lcfiplus::Vertex*, lcfiplus::VertexFinderSuehara::VertexFinderSueharaConfig&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3145154Z #19 0x00007f7a1919108c in lcfiplus::BuildUpVertex::process() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3145922Z #20 0x00007f7a1911025a in LcfiplusProcessor::processEvent(EVENT::LCEvent*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/lcfiplus/6a86ed6da1624c87dd6a9903b29191e94ca5d794_develop-go6npt/lib/libLCFIPlus.so.0.11.0
2025-09-30T08:19:54.3146414Z #21 0x00007f7a32beda5c in MarlinProcessorWrapper::execute (this=0xeccc100) at /Workarea/03_k4marlinwrapper/k4MarlinWrapper/src/components/MarlinProcessorWrapper.cpp:274
2025-09-30T08:19:54.3147006Z #22 0x00007f7a5d7ce49d in Gaudi::Algorithm::sysExecute(EventContext const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiKernel.so
2025-09-30T08:19:54.3147510Z #23 0x00007f7a406d4a0f in AlgTask::operator()() const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3148150Z #24 0x00007f7a406fcac3 in tbb::detail::d1::enqueue_task::execute(tbb::detail::d1::execution_data&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3148742Z #25 0x00007f7a5db2d602 in tbb::detail::r1::thread_dispatcher::process(rml::job&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3149412Z #26 0x00007f7a5db277cd in tbb::detail::r1::rml::private_worker::thread_routine(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3149557Z #27 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3149726Z #28 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3149730Z
2025-09-30T08:19:54.3149891Z Thread 3 (Thread 0x7f7a16dfc640 (LWP 2434) "python"):
2025-09-30T08:19:54.3150019Z #0 0x00007f7a5ec2470d in syscall () from /lib64/libc.so.6
2025-09-30T08:19:54.3150621Z #1 0x00007f7a5db0ceb7 in tbb::detail::r1::binary_semaphore::P() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3151222Z #2 0x00007f7a5db27a76 in tbb::detail::r1::rml::private_worker::thread_routine(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3151369Z #3 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3151493Z #4 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3151497Z
2025-09-30T08:19:54.3151613Z Thread 2 (Thread 0x7f7a169fb640 (LWP 2435) "python"):
2025-09-30T08:19:54.3151737Z #0 0x00007f7a5ebf5fff in wait4 () from /lib64/libc.so.6
2025-09-30T08:19:54.3151864Z #1 0x00007f7a5eb687e3 in do_system () from /lib64/libc.so.6
2025-09-30T08:19:54.3152408Z #2 0x00007f7a5d2d50e4 in TUnixSystem::StackTrace() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libCore.so.6.36
2025-09-30T08:19:54.3153086Z #3 0x00007f7a5d2d9694 in TUnixSystem::DispatchSignals(ESignals) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/root/6.36.04-6qfi76/lib/root/libCore.so.6.36
2025-09-30T08:19:54.3153169Z #4
2025-09-30T08:19:54.3153944Z #5 0x00007f7a309d92c0 in typeinfo name for TInstrumentedIsAProxy () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/kaltest/1a41489ccce18f1cd794700f625d03b38aa04c15_develop-lwjekx/lib/libKalTest.so.2.5
2025-09-30T08:19:54.3154768Z #6 0x00007f7a48174cca in DDVMeasLayer::GetEnergyLoss(bool, TVTrack const&, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/ddkaltest/9af3dfe9ee92799d78e09c68fda6991fede0af08_develop-nxaehx/lib/libDDKalTest.so.1.7
2025-09-30T08:19:54.3155880Z #7 0x00007f7a309aced0 in TKalDetCradle::Transport(TKalTrackSite const&, TVMeasLayer const&, TVector3&, TKalMatrix&, TKalMatrix&, TKalMatrix&, std::unique_ptr >&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/kaltest/1a41489ccce18f1cd794700f625d03b38aa04c15_develop-lwjekx/lib/libKalTest.so.2.5
2025-09-30T08:19:54.3156830Z #8 0x00007f7a309ae38a in TKalDetCradle::Transport(TKalTrackSite const&, TVMeasLayer const&, TVector3&, TKalMatrix&, TKalMatrix&, TKalMatrix&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/kaltest/1a41489ccce18f1cd794700f625d03b38aa04c15_develop-lwjekx/lib/libKalTest.so.2.5
2025-09-30T08:19:54.3157918Z #9 0x00007f7a3109a3f2 in MarlinTrk::MarlinDDKalTestTrack::propagate(dd4hep::rec::Vector3D const&, TKalTrackSite const&, IMPL::TrackStateImpl&, double&, int&, DDVMeasLayer const*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3158916Z #10 0x00007f7a3109c28a in MarlinTrk::MarlinDDKalTestTrack::propagate(dd4hep::rec::Vector3D const&, EVENT::TrackerHit*, IMPL::TrackStateImpl&, double&, int&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3160220Z #11 0x00007f7a310ab225 in MarlinTrk::finaliseLCIOTrack(MarlinTrk::IMarlinTrack*, IMPL::TrackImpl*, std::vector >&, bool, IMPL::TrackStateImpl*, IMPL::TrackStateImpl*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3161189Z #12 0x00007f7a17d75175 in RefitFinal::processEvent(EVENT::LCEvent*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrkprocessors/665b5fed8309e84cc4197b80012c02c680e32b90_develop-26s5ng/lib/libMarlinTrkProcessors.so.2.12.7
2025-09-30T08:19:54.3161691Z #13 0x00007f7a32beda5c in MarlinProcessorWrapper::execute (this=0xecb1ac0) at /Workarea/03_k4marlinwrapper/k4MarlinWrapper/src/components/MarlinProcessorWrapper.cpp:274
2025-09-30T08:19:54.3162279Z #14 0x00007f7a5d7ce49d in Gaudi::Algorithm::sysExecute(EventContext const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiKernel.so
2025-09-30T08:19:54.3162882Z #15 0x00007f7a406d4a0f in AlgTask::operator()() const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3163527Z #16 0x00007f7a406fcac3 in tbb::detail::d1::enqueue_task::execute(tbb::detail::d1::execution_data&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3164116Z #17 0x00007f7a5db2d602 in tbb::detail::r1::thread_dispatcher::process(rml::job&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3164714Z #18 0x00007f7a5db277cd in tbb::detail::r1::rml::private_worker::thread_routine(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3164856Z #19 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3164971Z #20 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3164977Z
2025-09-30T08:19:54.3165092Z Thread 1 (Thread 0x7f7a5f444740 (LWP 2408) "python"):
2025-09-30T08:19:54.3165217Z #0 0x00007f7a5ec2470d in syscall () from /lib64/libc.so.6
2025-09-30T08:19:54.3166031Z #1 0x00007f7a5db12bad in tbb::detail::r1::wait_bounded_queue_monitor(tbb::detail::r1::concurrent_monitor*, unsigned long, long, tbb::detail::d1::delegate_base&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3166651Z #2 0x00007f7a406d5fd0 in AvalancheSchedulerSvc::popFinishedEvent(EventContext*&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3167210Z #3 0x00007f7a4071eb66 in HiveSlimEventLoopMgr::drainScheduler(int&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3167758Z #4 0x00007f7a4071f637 in HiveSlimEventLoopMgr::nextEvent(int) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3168308Z #5 0x00007f7a4071b9a5 in HiveSlimEventLoopMgr::executeRun(int) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3168840Z #6 0x00007f7a59f2d425 in ApplicationMgr::executeRun(int) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiCoreSvc.so
2025-09-30T08:19:54.3169420Z #7 0x00007f7a5d7f007a in Gaudi::Application::run() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiKernel.so
2025-09-30T08:19:54.3170002Z #8 0x00007f7a5f3d5052 in ffi_call_unix64 () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/libffi/3.4.8-qqnz4e/lib64/libffi.so.8
2025-09-30T08:19:54.3170454Z #9 0x00007f7a5f3d2fbc in ffi_call_int () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/libffi/3.4.8-qqnz4e/lib64/libffi.so.8
2025-09-30T08:19:54.3170944Z #10 0x00007f7a5f3d3d9d in ffi_call () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/libffi/3.4.8-qqnz4e/lib64/libffi.so.8
2025-09-30T08:19:54.3171803Z #11 0x00007f7a5e37599f in _call_function_pointer (st=0x7f7a5e54ced0, flags=4353, pProc=0x7f7a5d7ec4d0 <_py_Gaudi__Application__run>, avalues=, atypes=, restype=, resmem=0x7ffce27108d0, argcount=1, argtypecount=) at ./Modules/_ctypes/callproc.c:950
2025-09-30T08:19:54.3171886Z #12 _ctypes_callproc (st=st
2025-09-30T08:19:54.3172126Z entry=0x7f7a5e54ced0, pProc=0x7f7a5d7ec4d0 <_py_Gaudi__Application__run>, argtuple=argtuple
2025-09-30T08:19:54.3172465Z entry=(209827920,), flags=4353, argtypes=, restype=, checker=0x0) at ./Modules/_ctypes/callproc.c:1301
2025-09-30T08:19:54.3173020Z #13 0x00007f7a5e373de5 in PyCFuncPtr_call (self=, inargs=, kwds=0x0) at ./Modules/_ctypes/_ctypes.c:4382
2025-09-30T08:19:54.3173712Z #14 0x00007f7a5ef98b0b in _PyObject_MakeTpCall (tstate=0x7f7a5f34ca30 <_PyRuntime+283024>, callable=<_FuncPtr(__name__='_py_Gaudi__Application__run') at remote 0x7f7a5df44dd0>, args=, nargs=1, keywords=) at Objects/call.c:242
2025-09-30T08:19:54.3174136Z #15 0x00007f7a5efaa747 in _PyEval_EvalFrameDefault (tstate=, frame=, throwflag=) at Python/generated_cases.c.h:813
2025-09-30T08:19:54.3179760Z #16 0x00007f7a5f076880 in PyEval_EvalCode (co=, globals={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated), locals={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated)) at Python/ceval.c:604
2025-09-30T08:19:54.3180022Z #17 0x00007f7a5f0b04bc in run_eval_code_obj (tstate=tstate
2025-09-30T08:19:54.3180182Z entry=0x7f7a5f34ca30 <_PyRuntime+283024>, co=co
2025-09-30T08:19:54.3180274Z entry=0x7f7a5e7d1080, globals=globals
2025-09-30T08:19:54.3183169Z entry={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated), locals=locals
2025-09-30T08:19:54.3185899Z entry={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated)) at Python/pythonrun.c:1381
2025-09-30T08:19:54.3185999Z #18 0x00007f7a5f0adc76 in run_mod (mod=mod
2025-09-30T08:19:54.3186087Z entry=0xc5bac70, filename=filename
2025-09-30T08:19:54.3186223Z entry='/Package/main/install/bin/k4run', globals=globals
2025-09-30T08:19:54.3188895Z entry={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated), locals=locals
2025-09-30T08:19:54.3191717Z entry={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated), flags=flags
2025-09-30T08:19:54.3191850Z entry=0x7ffce2710ed8, arena=arena
2025-09-30T08:19:54.3192094Z entry=0x7f7a5e7cd8f0, interactive_src=0x0, generate_new_source=0) at Python/pythonrun.c:1466
2025-09-30T08:19:54.3192190Z #19 0x00007f7a5f0aa9c5 in pyrun_file (fp=fp
2025-09-30T08:19:54.3192277Z entry=0xc4f7fa0, filename=filename
2025-09-30T08:19:54.3192401Z entry='/Package/main/install/bin/k4run', start=start
2025-09-30T08:19:54.3192481Z entry=257, globals=globals
2025-09-30T08:19:54.3195278Z entry={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated), locals=locals
2025-09-30T08:19:54.3197967Z entry={'__name__': '__main__', '__doc__': None, '__package__': None, '__loader__': , '__spec__': None, '__annotations__': {}, '__builtins__': , '__file__': '/Package/main/install/bin/k4run', '__cached__': None, 'os': , 'sys': , 'argparse': , 'logging': , 'signal': , 'warnings': , 'Path': , 'load_file': , 'get_logger': , 'set_log_level': , 'LOG_LEVELS': ('VERBOSE', 'DEBUG', 'INFO', 'WARNING', 'ERROR'), 'FILTER_GAUDI_PROPS': ['Cardinality', 'Context', 'CounterList', 'EfficiencyRowFormat', 'Enable', 'ErrorCount', 'ErrorMax', 'ErrorsPrint', 'ExtraInputs', 'ExtraOutp...(truncated), closeit=closeit
2025-09-30T08:19:54.3198110Z entry=1, flags=0x7ffce2710ed8) at Python/pythonrun.c:1295
2025-09-30T08:19:54.3198236Z #20 0x00007f7a5f0aa637 in _PyRun_SimpleFileObject (fp=fp
2025-09-30T08:19:54.3198319Z entry=0xc4f7fa0, filename=filename
2025-09-30T08:19:54.3198447Z entry='/Package/main/install/bin/k4run', closeit=closeit
2025-09-30T08:19:54.3198583Z entry=1, flags=flags
2025-09-30T08:19:54.3198691Z entry=0x7ffce2710ed8) at Python/pythonrun.c:517
2025-09-30T08:19:54.3198810Z #21 0x00007f7a5f0aa45a in _PyRun_AnyFileObject (fp=fp
2025-09-30T08:19:54.3198891Z entry=0xc4f7fa0, filename=filename
2025-09-30T08:19:54.3199013Z entry='/Package/main/install/bin/k4run', closeit=closeit
2025-09-30T08:19:54.3199141Z entry=1, flags=flags
2025-09-30T08:19:54.3199251Z entry=0x7ffce2710ed8) at Python/pythonrun.c:77
2025-09-30T08:19:54.3199733Z #22 0x00007f7a5f0a8b3b in pymain_run_file_obj (program_name='python', filename='/Package/main/install/bin/k4run', skip_source_first_line=0) at Modules/main.c:410
2025-09-30T08:19:54.3199929Z #23 pymain_run_file (config=0x7f7a5f31f128 <_PyRuntime+96392>) at Modules/main.c:429
2025-09-30T08:19:54.3200138Z #24 pymain_run_python (exitcode=0x7ffce2710ecc) at Modules/main.c:696
2025-09-30T08:19:54.3200228Z #25 Py_RunMain () at Modules/main.c:775
2025-09-30T08:19:54.3200482Z #26 0x00007f7a5f064b47 in Py_BytesMain (argc=, argv=) at Modules/main.c:829
2025-09-30T08:19:54.3200655Z #27 0x00007f7a5eb465d0 in __libc_start_call_main () from /lib64/libc.so.6
2025-09-30T08:19:54.3200813Z #28 0x00007f7a5eb46680 in __libc_start_main_impl () from /lib64/libc.so.6
2025-09-30T08:19:54.3200888Z #29 0x0000000000401065 in _start ()
2025-09-30T08:19:54.3200976Z ===========================================================
2025-09-30T08:19:54.3200982Z
2025-09-30T08:19:54.3200986Z
2025-09-30T08:19:54.3201149Z The lines below might hint at the cause of the crash. If you see question
2025-09-30T08:19:54.3201324Z marks as part of the stack trace, try to recompile with debugging information
2025-09-30T08:19:54.3201492Z enabled and export CLING_DEBUG=1 environment variable before running.
2025-09-30T08:19:54.3201664Z You may get help by asking at the ROOT forum https://root.cern/forum
2025-09-30T08:19:54.3201817Z preferably using the command (.forum bug) in the ROOT prompt.
2025-09-30T08:19:54.3201980Z Only if you are really convinced it is a bug in ROOT then please submit a
2025-09-30T08:19:54.3202181Z report at https://root.cern/bugs or (preferably) using the command (.gh bug) in
2025-09-30T08:19:54.3202298Z the ROOT prompt. Please post the ENTIRE stack trace
2025-09-30T08:19:54.3202423Z from above as an attachment in addition to anything else
2025-09-30T08:19:54.3202519Z that might help us fixing this issue.
2025-09-30T08:19:54.3202701Z ===========================================================
2025-09-30T08:19:54.3203503Z #5 0x00007f7a309d92c0 in typeinfo name for TInstrumentedIsAProxy () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/kaltest/1a41489ccce18f1cd794700f625d03b38aa04c15_develop-lwjekx/lib/libKalTest.so.2.5
2025-09-30T08:19:54.3204340Z #6 0x00007f7a48174cca in DDVMeasLayer::GetEnergyLoss(bool, TVTrack const&, double) const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/ddkaltest/9af3dfe9ee92799d78e09c68fda6991fede0af08_develop-nxaehx/lib/libDDKalTest.so.1.7
2025-09-30T08:19:54.3205453Z #7 0x00007f7a309aced0 in TKalDetCradle::Transport(TKalTrackSite const&, TVMeasLayer const&, TVector3&, TKalMatrix&, TKalMatrix&, TKalMatrix&, std::unique_ptr >&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/kaltest/1a41489ccce18f1cd794700f625d03b38aa04c15_develop-lwjekx/lib/libKalTest.so.2.5
2025-09-30T08:19:54.3206409Z #8 0x00007f7a309ae38a in TKalDetCradle::Transport(TKalTrackSite const&, TVMeasLayer const&, TVector3&, TKalMatrix&, TKalMatrix&, TKalMatrix&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/kaltest/1a41489ccce18f1cd794700f625d03b38aa04c15_develop-lwjekx/lib/libKalTest.so.2.5
2025-09-30T08:19:54.3207491Z #9 0x00007f7a3109a3f2 in MarlinTrk::MarlinDDKalTestTrack::propagate(dd4hep::rec::Vector3D const&, TKalTrackSite const&, IMPL::TrackStateImpl&, double&, int&, DDVMeasLayer const*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3208612Z #10 0x00007f7a3109c28a in MarlinTrk::MarlinDDKalTestTrack::propagate(dd4hep::rec::Vector3D const&, EVENT::TrackerHit*, IMPL::TrackStateImpl&, double&, int&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3209896Z #11 0x00007f7a310ab225 in MarlinTrk::finaliseLCIOTrack(MarlinTrk::IMarlinTrack*, IMPL::TrackImpl*, std::vector >&, bool, IMPL::TrackStateImpl*, IMPL::TrackStateImpl*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrk/5941fde4b5a24461d60d0bc40c0f75356cbcfad9_develop-jle4of/lib/libMarlinTrk.so.2.9
2025-09-30T08:19:54.3210732Z #12 0x00007f7a17d75175 in RefitFinal::processEvent(EVENT::LCEvent*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-30/x86_64-almalinux9-gcc14.2.0-opt/marlintrkprocessors/665b5fed8309e84cc4197b80012c02c680e32b90_develop-26s5ng/lib/libMarlinTrkProcessors.so.2.12.7
2025-09-30T08:19:54.3211232Z #13 0x00007f7a32beda5c in MarlinProcessorWrapper::execute (this=0xecb1ac0) at /Workarea/03_k4marlinwrapper/k4MarlinWrapper/src/components/MarlinProcessorWrapper.cpp:274
2025-09-30T08:19:54.3211825Z #14 0x00007f7a5d7ce49d in Gaudi::Algorithm::sysExecute(EventContext const&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiKernel.so
2025-09-30T08:19:54.3212330Z #15 0x00007f7a406d4a0f in AlgTask::operator()() const () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3213183Z #16 0x00007f7a406fcac3 in tbb::detail::d1::enqueue_task::execute(tbb::detail::d1::execution_data&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/gaudi/40.0-hqgvjz/lib/libGaudiHive.so
2025-09-30T08:19:54.3213789Z #17 0x00007f7a5db2d602 in tbb::detail::r1::thread_dispatcher::process(rml::job&) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3214401Z #18 0x00007f7a5db277cd in tbb::detail::r1::rml::private_worker::thread_routine(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2025-09-21/x86_64-almalinux9-gcc14.2.0-opt/intel-tbb/2022.0.0-sjg44y/lib64/libtbb.so.12
2025-09-30T08:19:54.3214543Z #19 0x00007f7a5eba719a in start_thread () from /lib64/libc.so.6
2025-09-30T08:19:54.3214663Z #20 0x00007f7a5ec2c210 in clone3 () from /lib64/libc.so.6
2025-09-30T08:19:54.3214668Z
2025-09-30T08:19:54.3214752Z ===========================================================
2025-09-30T08:19:54.3214756Z
2025-09-30T08:19:54.3214761Z
2025-09-30T08:19:54.3214917Z k4MarlinWrapper"] -1.657800e-09, +9.173839e-11, +2.514930e-12
2025-09-30T08:19:54.3215120Z [ DEBUG4 "k4MarlinWrapper"] -3.035676e-08, +3.286708e-13, -4.322881e-11, +4.174346e-04
2025-09-30T08:19:54.3215352Z [ DEBUG4 "k4MarlinWrapper"] +4.548166e-11, +2.515791e-11, +1.332050e-12, -1.273748e-05, +3.931326e-07
```
### Operating System and Version
Alma Linux 9
### compiler
GCC 14.2.0
### The version of the key4hep stack
Nightlies of 2025-09-30
### Package Version
main
### Reproducer
Compile and run the test.
### Additional context
How to fix: run ctest in an infinite loop until the test fails, and then use the input file to reproduce the error and investigate.
Contributor guide
Research direction
Start by locating and running the `clicRec_lcio_mt` test referenced in the issue, then compare failures with the linked GitHub Actions run and its stack trace. Trace the crash through the shown `MarlinProcessorWrapper.cpp:274` entry point and determine a reproducible fix; done means the test no longer fails intermittently in CI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100