Modifying nvidia gpu device is not possible?

Hello, I'd like to modify nvidia gpu device assignment with NRI.

I was able to modify or add environment variable with `adjust.AddEnv` and `adjust.RemoveEnv` function in `func (p *plugin) CreateContainer()`.

However, modifying nvidia gpu device assignment is not possible with below reasons.
1. I was not able to modify "NVIDIA_VISIBLE_DEVICES" environment variable.
2. `adjust.RemoveDevice` function is not working for nvidia gpu devices.

I mean in above, `adjust.AddDevice` function is working to add nvidia gpu device additionally to container. However, removing is not possible with `adjust.RemoveDevice` function.

Do you have any idea on this kind of behavior?
Any comments are welcome!