commaai / commaai/openpilot

tools/sim is not fun to use

Open
#31,714 3 comments 0 reactions 0 assignees View on GitHub
enhancement PC
Dominant language
Python
Stars
63.7k
Forks
11.4k
Avg merge
17h 53m
Merged PRs (30d)
171

Description

As discussed in https://github.com/commaai/openpilot/pull/31710 , the simulator controls are far from ideal. They are flickering and it is difficult to provide multiple inputs simultaneously.

To better capture keyboard events, we would need to open a window and that window would have to be focused. We could use Qt, Pygame (it's already a dependency of MetaDrive) or possibly another lib.

However just capturing keyboard events doesn't give much granularity. Maybe we could use sliders, measuring the pointer coordinates inside the box or some other method to better control that?

Contributor guide

Open the contributing guide

Research direction

Start with the tools/sim entry point and read the discussion in pull request #31710 to understand the simulator-control problems. Compare the possible Qt, Pygame, or other input approaches, then run the simulator to evaluate control responsiveness. Done means controls no longer flicker and allow multiple inputs with finer-grained interaction.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.