RuntimeError: batch dimension mismatch

python version is 3.9.16
torchrl version is 0.1.0+a32d2e7
torch version is 2.0.1

when creating a gym Instance：
from torchrl.envs.libs.gym import GymEnv
import torch
device = "cpu" if not torch.has_cuda else "cuda:0"
frame_skip = 1
base_env = GymEnv("InvertedDoublePendulum-v4", device=device, frame_skip=frame_skip)

throw the following exception：
RuntimeError: batch dimension mismatch, got self.batch_size=[] and value.shape[:self.batch_dims]=torch.Size([]) with value tensor([ 0.0663, 0.0682, -0.0238, 0.9977, 0.9997, 0.1421, 0.1762, -0.0032,
0.0000, 0.0000, 0.0000], dtype=torch.float64)