Error using ONNX Model zoo pb tests files

Bug Report

Which model does this pertain to?

Any Onnx Model Zoo model inside classification/vision path

Describe the bug

I'm trying to use test data files with protobuf TensorProtos, according with Model Zoo Readme (https://github.com/onnx/models#usage-). Has anyone use them with onnx runtime? I got an error related with the output/input size.

Reproduction instructions

System Information

• OS Platform and Distribution: Ubuntu 20.04.4 LTS
• ONNX Runtime installed from pip: 1.9.0
• Python version: 3.8.10
• Visual Studio version (if applicable): 1.69.0
• GCC/Compiler version (if compiling from source): 9.4.0
• CUDA/cuDNN version: NO NEED, CPU use only, Python and Jupyter notebooks
• GPU model and memory: NONE
• gluoncv version: 0.10.5
• matplotlib version: 3.4.3
• numpy version: 1.23.0
• mxnet version: 1.9.0.
• onnx version: 1.12.0
• protobuf version: 3.16.0
  
  

Start with the Model Zoo README usage section and the classification/vision test data referenced there. Reproduce the reported input/output-size error using the listed Python, ONNX Runtime, protobuf, and notebook environment, then determine whether the TensorProto files are supported and what usage or compatibility change is needed.