AWSClient: Response status: 504, Gateway Timeout causes Clickhouse crash & restart

### Company or project name

We use ClickHouse as an OLAP database for massive datasets and perform full database backups twice a week.

### Describe the unexpected behaviour

During the backup process, we intermittently encounter an S3 error followed by an automatic ClickHouse restart, causing downtime (approx. 20 minutes recently).

We attempted to backup without compression and only for specific tables, but the issue does not appear to be hardware-related, as it also occurs randomly on our other servers with smaller databases. (We run backups twice a week).

The failure pattern is random, occurring on different databases at different times. The currently affected database had successful backups in the past, and its data volume has not changed significantly.

We suspect an issue related to S3 storage, but we are unclear why it triggers a ClickHouse restart.

### Which ClickHouse versions are affected?

25.8.8.26

### How to reproduce

Whole database contains lot of data. 70+ tables, primarily MergeTree engine, but also PostgreSQL engine, Dictionaries.

OS: Ubuntu 24.04
Version: 25.8.8.26 LTS
Environment: Production
Server specs: 384 GB RAM, 48 cores. Database size: 861 GB. We don't use replicas.

Query:
BACKUP DATABASE *** TO S3('https://fsn1.your-objectstorage.com/***', '**', '***') SETTINGS password = '***', compression_method = 'zstd', compression_level = 3, backup_threads = 4, max_threads = 8, s3_max_unexpected_write_error_retries = 10, s3_max_connections = 50, s3_min_upload_part_size = 268435456, s3_max_single_part_upload_size = 268435456, s3_max_inflight_parts_for_one_file = 4, s3_max_put_rps = 300, s3_max_put_burst = 300, s3_connect_timeout_ms = 10000, s3_request_timeout_ms = 300000

Server settings:
max_query_size = 999999999999, queue_max_wait_ms = 120000, use_uncompressed_cache = false, load_balancing = 'random', log_queries = true, log_queries_min_query_duration_ms = 120000, joined_subquery_requires_alias = false, max_ast_elements = 100000000, max_memory_usage = 394063249408, log_query_threads = false, max_partitions_per_insert_block = 500, postgresql_connection_pool_auto_close_connection = true, format_display_secrets_in_show_and_select = true

### Expected behavior

Clickhouse just drops S3 error, and works fine

### Error message and/or stacktrace

```2026.01.07 13:16:24.049503 [ 1775553 ] {} BaseDaemon: ########## Short fault info ############
2026.01.07 13:16:24.049524 [ 1775553 ] {} BaseDaemon: (version 25.8.8.26 (official build), build id: 1275142F51AB448D8B03351ECF19B4739B97B158, git hash: 8a2475033080b4a8d57b7771f52140af663dd4e0, architecture: x86_64) (from thread 1776993) Received signal 6
2026.01.07 13:16:24.049539 [ 1775553 ] {} BaseDaemon: Signal description: Aborted
2026.01.07 13:16:24.049542 [ 1775553 ] {} BaseDaemon:
2026.01.07 13:16:24.049554 [ 1775553 ] {} BaseDaemon: Stack trace: 0x000076a7a589eb2d 0x000076a7a584527e 0x000076a7a58288ff 0x0000000015fb9726 0x000000001fc77c03 0x000000001fc78441 0x000000001fc77d23 0x000000001fc7e61f 0x000000001fc774da 0x00000000134bd6ce 0x0000000016351ad2 0x000000001fb318f6 0x000000001fb2d092 0x000000001fb3097f 0x000000001fb2ac47 0x0000000016351c99 0x0000000016351dc9 0x00000000169aa1be 0x000000001697e45a 0x0000000016988ecd 0x00000000169859cc 0x0000000014e44901 0x0000000014e44aac 0x000000001350a7eb 0x0000000013511b66 0x00000000135077d2 0x000000001350f29a 0x000076a7a589caa4 0x000076a7a5929c6c
2026.01.07 13:16:24.049562 [ 1775553 ] {} BaseDaemon: ########################################
2026.01.07 13:16:24.049668 [ 1775553 ] {} BaseDaemon: (version 25.8.8.26 (official build), build id: 1275142F51AB448D8B03351ECF19B4739B97B158, git hash: 8a2475033080b4a8d57b7771f52140af663dd4e0) (from thread 1776993) (query_id: d8981487-c9ff-4fb6-9c51-54b66798c8da) (query: BACKUP DATABASE *** TO S3('https://fsn1.your-objectstorage.com/***', '**', '***') SETTINGS password = '***', compression_method = 'zstd', compression_level = 3, backup_threads = 4, max_threads = 8, s3_max_unexpected_write_error_retries = 10, s3_max_connections = 50, s3_min_upload_part_size = 268435456, s3_max_single_part_upload_size = 268435456, s3_max_inflight_parts_for_one_file = 4, s3_max_put_rps = 300, s3_max_put_burst = 300, s3_connect_timeout_ms = 10000, s3_request_timeout_ms = 300000) Received signal Aborted (6)
2026.01.07 13:16:24.049734 [ 1775553 ] {} BaseDaemon:
2026.01.07 13:16:24.049776 [ 1775553 ] {} BaseDaemon: Stack trace: 0x000076a7a589eb2d 0x000076a7a584527e 0x000076a7a58288ff 0x0000000015fb9726 0x000000001fc77c03 0x000000001fc78441 0x000000001fc77d23 0x000000001fc7e61f 0x000000001fc774da 0x00000000134bd6ce 0x0000000016351ad2 0x000000001fb318f6 0x000000001fb2d092 0x000000001fb3097f 0x000000001fb2ac47 0x0000000016351c99 0x0000000016351dc9 0x00000000169aa1be 0x000000001697e45a 0x0000000016988ecd 0x00000000169859cc 0x0000000014e44901 0x0000000014e44aac 0x000000001350a7eb 0x0000000013511b66 0x00000000135077d2 0x000000001350f29a 0x000076a7a589caa4 0x000076a7a5929c6c
2026.01.07 13:16:24.049863 [ 1775553 ] {} BaseDaemon: 2. ? @ 0x000000000009eb2d
2026.01.07 13:16:24.049919 [ 1775553 ] {} BaseDaemon: 3. ? @ 0x000000000004527e
2026.01.07 13:16:24.049983 [ 1775553 ] {} BaseDaemon: 4. ? @ 0x00000000000288ff
2026.01.07 13:16:24.050064 [ 1775553 ] {} BaseDaemon: 5. terminate_handler() @ 0x0000000015fb9726
2026.01.07 13:16:24.050146 [ 1775553 ] {} BaseDaemon: 6. std::__terminate(void (*)()) @ 0x000000001fc77c03
2026.01.07 13:16:24.050238 [ 1775553 ] {} BaseDaemon: 7. __cxxabiv1::scan_eh_tab(__cxxabiv1::(anonymous namespace)::scan_results&, _Unwind_Action, bool, _Unwind_Exception*, _Unwind_Context*) @ 0x000000001fc78441
2026.01.07 13:16:24.050331 [ 1775553 ] {} BaseDaemon: 8. __gxx_personality_v0 @ 0x000000001fc77d23
2026.01.07 13:16:24.050413 [ 1775553 ] {} BaseDaemon: 9. _Unwind_RaiseException @ 0x000000001fc7e61f
2026.01.07 13:16:24.050513 [ 1775553 ] {} BaseDaemon: 10. __cxa_throw @ 0x000000001fc774da
2026.01.07 13:16:24.050593 [ 1775553 ] {} BaseDaemon: 11. DB::WriteBuffer::write(char const*, unsigned long) @ 0x00000000134bd6ce
2026.01.07 13:16:24.050685 [ 1775553 ] {} BaseDaemon: 12. DB::ZipArchiveWriter::StreamInfo::writeFileFunc(void*, void*, void const*, unsigned long) @ 0x0000000016351ad2
2026.01.07 13:16:24.050771 [ 1775553 ] {} BaseDaemon: 13. mz_stream_ioapi_write @ 0x000000001fb318f6
2026.01.07 13:16:24.050850 [ 1775553 ] {} BaseDaemon: 14. mz_stream_wzaes_write @ 0x000000001fb2d092
2026.01.07 13:16:24.050945 [ 1775553 ] {} BaseDaemon: 15. mz_stream_zstd_close @ 0x000000001fb3097f
2026.01.07 13:16:24.051012 [ 1775553 ] {} BaseDaemon: 16. mz_zip_entry_write_close @ 0x000000001fb2ac47
2026.01.07 13:16:24.051101 [ 1775553 ] {} BaseDaemon: 17. DB::ZipArchiveWriter::WriteBufferFromZipArchive::~WriteBufferFromZipArchive() @ 0x0000000016351c99
2026.01.07 13:16:24.051190 [ 1775553 ] {} BaseDaemon: 18. DB::ZipArchiveWriter::WriteBufferFromZipArchive::~WriteBufferFromZipArchive() @ 0x0000000016351dc9
2026.01.07 13:16:24.051312 [ 1775553 ] {} BaseDaemon: 19. DB::BackupImpl::writeFile(DB::BackupFileInfo const&, std::shared_ptr) @ 0x00000000169aa1be
2026.01.07 13:16:24.051413 [ 1775553 ] {} BaseDaemon: 20. DB::BackupsWorker::writeBackupEntries(std::shared_ptr, std::vector>, std::allocator>>>&&, String const&, std::shared_ptr, bool, std::shared_ptr)::$_0::operator()() const @ 0x000000001697e45a
2026.01.07 13:16:24.051512 [ 1775553 ] {} BaseDaemon: 21. DB::BackupsWorker::BackupStarter::doBackup() @ 0x0000000016988ecd
2026.01.07 13:16:24.051608 [ 1775553 ] {} BaseDaemon: 22. void std::__function::__policy_invoker::__call_impl[abi:ne190107] const&, std::shared_ptr const&)::$_0, void ()>>(std::__function::__policy_storage const*) @ 0x00000000169859cc
2026.01.07 13:16:24.051722 [ 1775553 ] {} BaseDaemon: 23. std::__packaged_task_func (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority)::'lambda'(), std::allocator (std::function&&, Priority)> DB::threadPoolCallbackRunnerUnsafe>(ThreadPoolImpl>&, String const&)::'lambda'(std::function&&, Priority)::operator()(std::function&&, Priority)::'lambda'()>, void ()>::operator()() @ 0x0000000014e44901
2026.01.07 13:16:24.051812 [ 1775553 ] {} BaseDaemon: 24. std::packaged_task::operator()() @ 0x0000000014e44aac
2026.01.07 13:16:24.051903 [ 1775553 ] {} BaseDaemon: 25. ThreadPoolImpl>::ThreadFromThreadPool::worker() @ 0x000000001350a7eb
2026.01.07 13:16:24.051987 [ 1775553 ] {} BaseDaemon: 26. void std::__function::__policy_invoker::__call_impl[abi:ne190107]::ThreadFromGlobalPoolImpl>::ThreadFromThreadPool::*)(), ThreadPoolImpl>::ThreadFromThreadPool*>(void (ThreadPoolImpl>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl>::ThreadFromThreadPool*&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x0000000013511b66
2026.01.07 13:16:24.052085 [ 1775553 ] {} BaseDaemon: 27. ThreadPoolImpl::ThreadFromThreadPool::worker() @ 0x00000000135077d2
2026.01.07 13:16:24.052178 [ 1775553 ] {} BaseDaemon: 28. void* std::__thread_proxy[abi:ne190107]>, void (ThreadPoolImpl::ThreadFromThreadPool::*)(), ThreadPoolImpl::ThreadFromThreadPool*>>(void*) @ 0x000000001350f29a
2026.01.07 13:16:24.052257 [ 1775553 ] {} BaseDaemon: 29. ? @ 0x000000000009caa4
2026.01.07 13:16:24.052341 [ 1775553 ] {} BaseDaemon: 30. ? @ 0x0000000000129c6c
2026.01.07 13:16:24.237867 [ 1775553 ] {} BaseDaemon: Integrity check of the executable successfully passed (checksum: C9F4DE12801BA5BB5CA0888A285B0309)
2026.01.07 13:16:40.015892 [ 1775553 ] {} BaseDaemon: Report this error to https://github.com/ClickHouse/ClickHouse/issues
2026.01.07 13:16:40.016140 [ 1775553 ] {} BaseDaemon: Changed settings: max_query_size = 999999999999, queue_max_wait_ms = 120000, use_uncompressed_cache = false, load_balancing = 'random', log_queries = true, log_queries_min_query_duration_ms = 120000, joined_subquery_requires_alias = false, max_ast_elements = 100000000, max_memory_usage = 394063249408, log_query_threads = false, max_partitions_per_insert_block = 500, postgresql_connection_pool_auto_close_connection = true, format_display_secrets_in_show_and_select = true
```

### Additional context

Occasionally, dmesg -T captures logs for ClickHouse, though it did not happen during previous incidents. The logs below indicate multiple ClickHouse threads (including AsyncTextLog, AsyncLog, and TraceCollector) entering a blocked state (D state) for over 120 seconds, leading to a kernel hung task timeout.

```[Tue Dec 2 01:06:20 2025] INFO: task clickhouse-serv:13715 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:clickhouse-serv state:D stack:0 pid:13715 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_user_addr_fault+0x334/0x670
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit_to_user_mode+0x7b/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? exc_page_fault+0x94/0x1b0
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:00007ffcf3b4f700 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffe00 RBX: 00007ffcf3b52ea0 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 00007ffcf3b52ec8
[Tue Dec 2 01:06:20 2025] RBP: 00007ffcf3b4f740 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 00007ffcf3b52e78 R15: 00007ffcf3b52ec8
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task AsyncTextLog:13719 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:AsyncTextLog state:D stack:0 pid:13719 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? __mod_lruvec_state+0x36/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __lruvec_stat_mod_folio+0x70/0xc0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? set_ptes.isra.0+0x2b/0xb0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_anonymous_page+0x1a3/0x430
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? handle_pte_fault+0x1cb/0x1d0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __handle_mm_fault+0x654/0x800
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __count_memcg_events+0x6b/0x120
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? count_memcg_events.constprop.0+0x2a/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? handle_mm_fault+0xad/0x380
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_user_addr_fault+0x334/0x670
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit_to_user_mode+0x7b/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? exc_page_fault+0x94/0x1b0
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab301f4dd0 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffe00 RBX: 000079ab31bdce50 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab31bdce7c
[Tue Dec 2 01:06:20 2025] RBP: 000079ab301f4e10 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab31bdcea0 R15: 000079ab31bdce7c
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task AsyncLog:13720 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:AsyncLog state:D stack:0 pid:13720 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? ksys_write+0xe6/0x100
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_futex+0x18e/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __x64_sys_futex+0x12a/0x200
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? common_interrupt+0x54/0xb0
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab325f4db0 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffe00 RBX: 000079ab31b90170 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab31b9019c
[Tue Dec 2 01:06:20 2025] RBP: 000079ab325f4df0 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab31b901c0 R15: 000079ab31b9019c
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task AsyncLog:13721 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:AsyncLog state:D stack:0 pid:13721 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_futex+0x18e/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __x64_sys_futex+0x12a/0x200
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? futex_wait+0x74/0x120
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? rseq_get_rseq_cs+0x22/0x280
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? rseq_ip_fixup+0x90/0x1f0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_futex+0x105/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab333f4db0 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffe00 RBX: 000079ab31b900b0 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab31b900dc
[Tue Dec 2 01:06:20 2025] RBP: 000079ab333f4df0 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab31b90100 R15: 000079ab31b900dc
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task clickhouse-serv:13722 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:clickhouse-serv state:D stack:0 pid:13722 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] ? __schedule+0x284/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? vfs_read+0x34e/0x390
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __sys_sendto+0x18f/0x230
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __x64_sys_poll+0xc7/0x150
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_futex+0x18e/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __x64_sys_futex+0x12a/0x200
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? handle_pte_fault+0x1cb/0x1d0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __count_memcg_events+0x6b/0x120
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? count_memcg_events.constprop.0+0x2a/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? handle_mm_fault+0xad/0x380
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_user_addr_fault+0x334/0x670
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit_to_user_mode+0x7b/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? exc_page_fault+0x94/0x1b0
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33d1baca
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab2f1f2470 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffe00 RBX: 0000000000000000 RCX: 000079ab33d1baca
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000218 RSI: 000079ab2f1f2d50 RDI: 0000000000000007
[Tue Dec 2 01:06:20 2025] RBP: 000079ab2f1f2490 R08: 0000000000000000 R09: 0000000000000000
[Tue Dec 2 01:06:20 2025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000218
[Tue Dec 2 01:06:20 2025] R13: 7fffffffffffffff R14: 000079ab2f1f28a0 R15: 000079ab2f1f24e0
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task clickhouse-serv:13723 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:clickhouse-serv state:D stack:0 pid:13723 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] ? __pfx_hrtimer_wakeup+0x10/0x10
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __blk_flush_plug+0xdf/0x130
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? madvise_walk_vmas+0xc1/0x140
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? blk_finish_plug+0x31/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_madvise+0x153/0x270
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? madvise_vma_behavior+0x799/0x810
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __blk_flush_plug+0xdf/0x130
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? madvise_walk_vmas+0xc1/0x140
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? blk_finish_plug+0x31/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_madvise+0x153/0x270
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab2f9f3da0 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffdfc RBX: 000079ab33a16608 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab33a16634
[Tue Dec 2 01:06:20 2025] RBP: 000079ab2f9f3de0 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 000079ab2f9f3ed0 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab33a16678 R15: 000079ab33a16634
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task clickhouse-serv:13724 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:clickhouse-serv state:D stack:0 pid:13724 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] ? __pfx_hrtimer_wakeup+0x10/0x10
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab00bf4e10 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffdfc RBX: 000079ab33a166d8 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab33a16704
[Tue Dec 2 01:06:20 2025] RBP: 000079ab00bf4e50 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 000079ab00bf4f40 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab33a16748 R15: 000079ab33a16704
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task clickhouse-serv:13725 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:clickhouse-serv state:D stack:0 pid:13725 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] ? __pfx_hrtimer_wakeup+0x10/0x10
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079ab003f3e10 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffdfc RBX: 000079ab33a167a8 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab33a167d0
[Tue Dec 2 01:06:20 2025] RBP: 000079ab003f3e50 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 000079ab003f3f40 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab33a16818 R15: 000079ab33a167d0
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task TraceCollector:13726 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:TraceCollector state:D stack:0 pid:13726 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] ? __schedule+0x284/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? vfs_read+0x34e/0x390
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? rseq_ip_fixup+0x90/0x1f0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? restore_fpregs_from_fpstate+0x3d/0xd0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? switch_fpu_return+0x55/0xf0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? vfs_read+0x34e/0x390
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? rseq_get_rseq_cs+0x22/0x280
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? rseq_ip_fixup+0x90/0x1f0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? restore_fpregs_from_fpstate+0x3d/0xd0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? switch_fpu_return+0x55/0xf0
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __handle_mm_fault+0x654/0x800
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? __count_memcg_events+0x6b/0x120
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? count_memcg_events.constprop.0+0x2a/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? handle_mm_fault+0xad/0x380
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_user_addr_fault+0x334/0x670
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit_to_user_mode+0x7b/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? irqentry_exit+0x43/0x50
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? exc_page_fault+0x94/0x1b0
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33d1baca
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079aaffbf2100 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffe00 RBX: 0000000000000000 RCX: 000079ab33d1baca
[Tue Dec 2 01:06:20 2025] RDX: 0000000000100000 RSI: 000079aafe61e580 RDI: 000000000000000f
[Tue Dec 2 01:06:20 2025] RBP: 000079aaffbf2120 R08: 0000000000000000 R09: 0000000000000000
[Tue Dec 2 01:06:20 2025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000100000
[Tue Dec 2 01:06:20 2025] R13: 000079a75b269de8 R14: 000079aaffbf2478 R15: 000079aaffbf2170
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] INFO: task clickhouse-serv:13728 blocked for more than 122 seconds.
[Tue Dec 2 01:06:20 2025] Not tainted 6.8.0-85-generic #85-Ubuntu
[Tue Dec 2 01:06:20 2025] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Tue Dec 2 01:06:20 2025] task:clickhouse-serv state:D stack:0 pid:13728 tgid:13715 ppid:13707 flags:0x00004002
[Tue Dec 2 01:06:20 2025] Call Trace:
[Tue Dec 2 01:06:20 2025]
[Tue Dec 2 01:06:20 2025] __schedule+0x27c/0x6b0
[Tue Dec 2 01:06:20 2025] schedule+0x33/0x110
[Tue Dec 2 01:06:20 2025] do_exit+0x117/0x530
[Tue Dec 2 01:06:20 2025] do_group_exit+0x35/0x90
[Tue Dec 2 01:06:20 2025] get_signal+0x96e/0x9b0
[Tue Dec 2 01:06:20 2025] ? __pfx_hrtimer_wakeup+0x10/0x10
[Tue Dec 2 01:06:20 2025] arch_do_signal_or_restart+0x39/0x120
[Tue Dec 2 01:06:20 2025] syscall_exit_to_user_mode+0x206/0x260
[Tue Dec 2 01:06:20 2025] do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? syscall_exit_to_user_mode+0x86/0x260
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] ? do_syscall_64+0x8c/0x180
[Tue Dec 2 01:06:20 2025] ? srso_alias_return_thunk+0x5/0xfbef5
[Tue Dec 2 01:06:20 2025] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Tue Dec 2 01:06:20 2025] RIP: 0033:0x79ab33c98d71
[Tue Dec 2 01:06:20 2025] RSP: 002b:000079aafdbf4e10 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
[Tue Dec 2 01:06:20 2025] RAX: fffffffffffffdfc RBX: 000079ab33a16878 RCX: 000079ab33c98d71
[Tue Dec 2 01:06:20 2025] RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000079ab33a168a0
[Tue Dec 2 01:06:20 2025] RBP: 000079aafdbf4e50 R08: 0000000000000000 R09: 00000000ffffffff
[Tue Dec 2 01:06:20 2025] R10: 000079aafdbf4f40 R11: 0000000000000246 R12: 0000000000000000
[Tue Dec 2 01:06:20 2025] R13: 0000000000000000 R14: 000079ab33a168e8 R15: 000079ab33a168a0
[Tue Dec 2 01:06:20 2025] ```

Zabbix:
`[Problem: Load average is too high (per CPU load over 1.5 for 5m)]
Event time
2026.01.07 13:21:53
Severity
Average
Opdata
Load averages(1m 5m 15m): (1192.444824 688.592285 346.793945), # of CPUs: 96
Event tags
Application:CPU
Trigger description
Per CPU load average is too high. Your system may be slow to respond.`

Clickhouse wasn`t responding during till

`[Problem: ClickHouse: Port 8123 is unavaliable]
Event time
2026.01.07 13:43:59
`
And it became ok (looks like restated)