Force Attach USB devices to VM and also remember ttyUSB index

It would be great to force-attach a USB device to a VM, like in other virtualisation software.
for e.g I have a Home Assistant VM, I need to automatically attach a Zigbee Coordinator (USB) and a Zwave (USB) to the machine.

you can do it manually currently but every time you reboot the VM it's gone !
It would be also great to save the ttyUSB index because in my experience it's random (I think which one is attached first) and it's mess up with my config all the time