"RuntimeError: No HIP GPUs are available" on AMD 6700XT (Ubuntu 22.04.2)

### Specifications:
**OS: Ubuntu 22.04.2 LTS**

**Ry-zen 7 3700X:**
` *-cpu
description: CPU
product: AMD Ryzen 7 3700X 8-Core Processor
vendor: Advanced Micro Devices [AMD]
physical id: 11
bus info: cpu@0
version: 23.113.0
serial: Unknown
slot: AM4
size: 2794MHz
capacity: 4426MHz
width: 64 bits
clock: 100MHz
`

**AMD Rad-eon 6700XT:**
`*-display
description: VGA compatible controller
product: Navi 22 [Radeon RX 6700/6700 XT / 6800M]
vendor: Advanced Micro Devices, Inc. [AMD/ATI]
physical id: 0
bus info: pci@0000:08:00.0
logical name: /dev/fb0
version: c1
width: 64 bits
clock: 33MHz
capabilities: pm pciexpress msi vga_controller bus_master cap_list rom fb
configuration: depth=32 driver=amdgpu latency=0 mode=1920x1080 resolution=2560,1080 visual=truecolor xres=1920 yres=1080
`

I have ROCm installed with: `sudo amdgpu-install --usecase = hiplibsdk, rocm` following AMDs instructions for Ubuntu 22.04

`ROCm System Management Interface
Concise Info
GPU Temp (DieEdge) AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU%
0 48.0c 8.0W 500Mhz 96Mhz 0% auto 203.0W 6% 0%
End of ROCm SMI Log
`

I installed Comfy UI following the Installation Guide for Linux.

Everything works fine until I prompt something. On prompt I get following error:
`got prompt
Global Step: 470000
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
ERROR STARTS HERE
Traceback (most recent call last):
File "/home/karl/ComfyUI/execution.py", line 185, in execute
recursive_execute(self.server, prompt, self.outputs, x, extra_data, executed)
File "/home/karl/ComfyUI/execution.py", line 58, in recursive_execute
recursive_execute(server, prompt, outputs, input_unique_id, extra_data, executed)
File "/home/karl/ComfyUI/execution.py", line 58, in recursive_execute
recursive_execute(server, prompt, outputs, input_unique_id, extra_data, executed)
File "/home/karl/ComfyUI/execution.py", line 58, in recursive_execute
recursive_execute(server, prompt, outputs, input_unique_id, extra_data, executed)
File "/home/karl/ComfyUI/execution.py", line 67, in recursive_execute
outputs[unique_id] = getattr(obj, obj.FUNCTION)(**input_data_all)
File "/home/karl/ComfyUI/nodes.py", line 290, in load_checkpoint
out = comfy.sd.load_checkpoint_guess_config(ckpt_path, output_vae=True, output_clip=True, embedding_directory=folder_paths.get_folder_paths("embeddings"))
File "/home/karl/ComfyUI/comfy/sd.py", line 970, in load_checkpoint_guess_config
vae = VAE()
File "/home/karl/ComfyUI/comfy/sd.py", line 513, in __init__
device = model_management.get_torch_device()
File "/home/karl/ComfyUI/comfy/model_management.py", line 250, in get_torch_device
return torch.cuda.current_device()
File "/home/karl/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 674, in current_device
_lazy_init()
File "/home/karl/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 247, in _lazy_init
torch._C._cuda_init()
RuntimeError: No HIP GPUs are available`

I'm guessing this is a issue between Torch and ROCm, any things I could try and or solutions?