AlibabaResearch / AlibabaResearch/AdvancedLiterateMachinery

Issue exporting VGT model to ONNX - RuntimeError: invalid unordered_map<K, T> key

Ouverte
#191 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
C++
Étoiles
1.8k
Forks
195
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

Hi all,

I'm attempting to export the VGT model to ONNX format, but I'm encountering an issue where I get the following error:

```arduino
File ...\VGT\object_detection\ditod\VGTbeit.py:795
vis_x = checkpoint.checkpoint(blk, vis_x, rel_pos_bias, training_window_size)
...
RuntimeError: invalid unordered_map key
```

I’ve set up the export for the model’s backbone using dummy data for both image and grid inputs as follows:

VGTTrainer.py
```python
def export_to_onnx(self, export_path, opset_version=17, device="cpu"):

dummy_image = torch.randn(3, 1132, 800).to(device)
dummy_input_ids = torch.randint(0, 30522, (1, 1209)).to(device)
dummy_bbox = torch.randn(1, 1209, 4).to(device)
dummy_height = torch.tensor([1132], dtype=torch.int64).to(device)
dummy_width = torch.tensor([800], dtype=torch.int64).to(device)

torch.onnx.export(
self.model.backbone,
(dummy_image, dummy_bbox, dummy_input_ids, dummy_height, dummy_width),
export_path,
opset_version=opset_version,
input_names=["image", "bbox", "input_ids", "height", "width"],
output_names=["instances"],
dynamic_axes= {
"image": { 1: "height", 2: "width"},
"bbox": {0: "num_boxes"},
"input_ids": {0: "num_input_ids"}
}
)
```

I encounter the same exception if I try exporting the entire model (self.model) with dummy data.

Any guidance on troubleshooting or resolving this export error would be greatly appreciated!

Thank you!

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.