commaai / commaai/openpilot

replay on device hangs

Open
#36,937 2 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
63.7k
Forks
11.4k
Avg merge
17h 53m
Merged PRs (30d)
171

Description

`journalctl -k -n 200 --no-pager`

```
Dec 20 04:14:56 comma-8c64008d kernel: kworker/u16:2 D 0 324 2 0x00000000
Dec 20 04:14:56 comma-8c64008d kernel: Workqueue: pm_workerq_venus venus_hfi_pm_handler
Dec 20 04:14:56 comma-8c64008d kernel: Call trace:
Dec 20 04:14:56 comma-8c64008d kernel: [] __switch_to+0xb0/0xe0
Dec 20 04:14:56 comma-8c64008d kernel: [] __schedule+0x200/0x728
Dec 20 04:14:56 comma-8c64008d kernel: [] schedule+0x38/0x98
Dec 20 04:14:56 comma-8c64008d kernel: [] schedule_preempt_disabled+0x1c/0x30
Dec 20 04:14:56 comma-8c64008d kernel: [] __mutex_lock_slowpath+0xac/0x1a8
Dec 20 04:14:56 comma-8c64008d kernel: [] mutex_lock+0x4c/0x50
Dec 20 04:14:56 comma-8c64008d kernel: [] venus_hfi_pm_handler+0xe0/0x970
Dec 20 04:14:56 comma-8c64008d kernel: [] process_one_work+0x20c/0x4d8
Dec 20 04:14:56 comma-8c64008d kernel: [] worker_thread+0x50/0x4d0
Dec 20 04:14:56 comma-8c64008d kernel: [] kthread+0x100/0x108
Dec 20 04:14:56 comma-8c64008d kernel: [] ret_from_fork+0x10/0x50
Dec 20 04:14:56 comma-8c64008d kernel: kworker/u16:8 D 0 4450 2 0x00000000
Dec 20 04:14:56 comma-8c64008d kernel: Workqueue: kgsl_devfreq_wq do_devfreq_notify
Dec 20 04:14:56 comma-8c64008d kernel: Call trace:
Dec 20 04:14:56 comma-8c64008d kernel: [] __switch_to+0xb0/0xe0
Dec 20 04:14:56 comma-8c64008d kernel: [] __schedule+0x200/0x728
Dec 20 04:14:56 comma-8c64008d kernel: [] schedule+0x38/0x98
Dec 20 04:14:56 comma-8c64008d kernel: [] __rt_mutex_slowlock+0x58/0x100
Dec 20 04:14:56 comma-8c64008d kernel: [] rt_mutex_slowlock+0xb8/0x1b0
Dec 20 04:14:56 comma-8c64008d kernel: [] rt_mutex_lock+0x64/0x68
Dec 20 04:14:56 comma-8c64008d kernel: [] update_request_adhoc+0x34/0x440
Dec 20 04:14:56 comma-8c64008d kernel: [] msm_bus_scale_client_update_request+0x34/0x68
Dec 20 04:14:56 comma-8c64008d kernel: [] devbw_target+0x11c/0x1a0
Dec 20 04:14:56 comma-8c64008d kernel: [] update_devfreq+0xec/0x1f8
Dec 20 04:14:56 comma-8c64008d kernel: [] devfreq_vbif_update_bw+0x5c/0xb0
Dec 20 04:14:56 comma-8c64008d kernel: [] kgsl_pwrctrl_buslevel_update+0xb8/0x248
Dec 20 04:14:56 comma-8c64008d kernel: [] kgsl_busmon_target+0xf0/0x178
Dec 20 04:14:56 comma-8c64008d kernel: [] update_devfreq+0xec/0x1f8
Dec 20 04:14:56 comma-8c64008d kernel: [] tz_notify+0x84/0xa8
Dec 20 04:14:56 comma-8c64008d kernel: [] notifier_call_chain+0x5c/0x98
Dec 20 04:14:56 comma-8c64008d kernel: [] __srcu_notifier_call_chain+0x78/0xb8
Dec 20 04:14:56 comma-8c64008d kernel: [] srcu_notifier_call_chain+0x3c/0x50
Dec 20 04:14:56 comma-8c64008d kernel: [] do_devfreq_notify+0x2c/0x38
Dec 20 04:14:56 comma-8c64008d kernel: [] process_one_work+0x20c/0x4d8
Dec 20 04:14:56 comma-8c64008d kernel: [] worker_thread+0x50/0x4d0
Dec 20 04:14:56 comma-8c64008d kernel: [] kthread+0x100/0x108
Dec 20 04:14:56 comma-8c64008d kernel: [] ret_from_fork+0x10/0x50
Dec 20 04:14:56 comma-8c64008d kernel: python3 ./selfd D 0 49776 49143 0x00000001
Dec 20 04:14:56 comma-8c64008d kernel: Call trace:
Dec 20 04:14:56 comma-8c64008d kernel: [] __switch_to+0xb0/0xe0
Dec 20 04:14:56 comma-8c64008d kernel: [] __schedule+0x200/0x728
Dec 20 04:14:56 comma-8c64008d kernel: [] schedule+0x38/0x98
Dec 20 04:14:56 comma-8c64008d kernel: [] schedule_preempt_disabled+0x1c/0x30
Dec 20 04:14:56 comma-8c64008d kernel: [] __mutex_lock_slowpath+0xac/0x1a8
Dec 20 04:14:56 comma-8c64008d kernel: [] mutex_lock+0x4c/0x50
Dec 20 04:14:56 comma-8c64008d kernel: [] sendcmd+0x60/0x5b0
Dec 20 04:14:56 comma-8c64008d kernel: [] _adreno_dispatcher_issuecmds.part.9+0x180/0x6e8
Dec 20 04:14:56 comma-8c64008d kernel: [] adreno_dispatcher_queue_cmds+0x884/0x918
Dec 20 04:14:56 comma-8c64008d kernel: [] kgsl_ioctl_gpu_command+0x1c8/0x368
Dec 20 04:14:56 comma-8c64008d kernel: [] kgsl_ioctl_helper+0xac/0x170
Dec 20 04:14:56 comma-8c64008d kernel: [] kgsl_ioctl+0x50/0xf0
Dec 20 04:14:56 comma-8c64008d kernel: [] do_vfs_ioctl+0xc4/0x810
Dec 20 04:14:56 comma-8c64008d kernel: [] SyS_ioctl+0x90/0xa8
Dec 20 04:14:56 comma-8c64008d kernel: [] el0_svc_naked+0x34/0x38
Dec 20 04:14:56 comma-8c64008d kernel: replay D 0 50165 49776 0x00000000
```

Contributor guide

Open the contributing guide

Research direction

The report names no source file or test. Reproduce replay on the device, collect `journalctl -k -n 200 --no-pager`, and inspect the Venus/KGSL workqueue traces; done means replay completes without hanging and the reported kernel wait state is no longer observed.

Written by the indexing model from the issue text.

Assessment

Tech stack
linux, python
Domain
embedded-iot, operating-systems
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.