Inferencing with T5

Bug Report

Which model does this pertain to?

T5

Describe the bug

Running the script in colab

from onnxt5 import GenerativeT5
from onnxt5.api import get_encoder_decoder_tokenizer
decoder_sess, encoder_sess, tokenizer = get_encoder_decoder_tokenizer()
generative_t5 = GenerativeT5(encoder_sess, decoder_sess, tokenizer, onnx=True)
prompt = 'translate English to French: I was a victim of a series of accidents.'
output_text, output_logits = generative_t5(prompt, max_length=100, temperature=0.)

Results in

It doesn't give an error or anything, just stops execution like so.

Provide a code snippet to reproduce your errors.
In google colab, run

!pip install onnxt5
from onnxt5 import GenerativeT5
from onnxt5.api import get_encoder_decoder_tokenizer
decoder_sess, encoder_sess, tokenizer = get_encoder_decoder_tokenizer()
generative_t5 = GenerativeT5(encoder_sess, decoder_sess, tokenizer, onnx=True)
prompt = 'translate English to French: I was a victim of a series of accidents.'
output_text, output_logits = generative_t5(prompt, max_length=100, temperature=0.)

Reproduce the report in the Google Colab script using onnxt5's GenerativeT5 and get_encoder_decoder_tokenizer entry points, with the supplied translation prompt and max_length/temperature settings. Inspect where execution stops and compare the observed behavior with the expected generated text and logits; the issue is resolved when inference completes and returns output without silently stopping.