Yubikey USB device access issue

**Describe the issue**
Virtual intel linux guest using USB Sharing only able to use usb device as root user.

I'm trying to get my personal Yubikey to be accessible on an opensuse tumbleweed guest. I have sharing setup and have the USB showing up in the dev tree. When I try and issue the following command I get a "Failed to connect to yubikey. Try removing and reconnecting the device." When I sudo the exact same command I can see the expected output of the keys stored on the Yubikey.

yubico-piv-tool -a status -s 9a

I cannot "sudo ssh-add -s /usr/lib64/libykcs11.so.2" to get the Yubikey added to my ssh keychain as that would issue the add to root's keys and not my own.

When I have done this in the past on a VMware virtuals, I have not had permissions issues accessing the usb device. I'm thinking it's a setting that is not setup correctly in my UTM, but am unable to find ANY documentation on this topic.

**Configuration**
* UTM Version: 4.0.9 (68)
* macOS Version: Ventura 13.1
* Mac Chip (Intel, M1, ...): M1