.Net After updating to .5, Phi3.5Mini outputs some meaningless characters

Window11 24H2Ltsc .netCore 8 cuda Model:Phi-3.5-mini-instruct-onnx\cuda\cuda-int4-awq-block-128

We have a sample dialog to test the output.


in 0.4
Phi3.5 output
"I dont know"

In 0.5.2

Code

In 0.5.2 Qwen2 It will also output some meaningless exclamation points，
Qwen2 Model Qwen2-1.5B

We made the conversion with reference to the [link](https://github.com/microsoft/onnxruntime-genai/tree/main/src/python/py/models#full-usage) parameter Int4 Cuda
Qwen2 output


Start by reproducing the sample dialog with Phi-3.5-mini-instruct-onnx and Qwen2-1.5B on version 0.5.2, comparing the output with 0.4. Review the conversion parameters in the linked model-conversion documentation. Done means both models produce meaningful output rather than meaningless characters or exclamation points.

Written by the indexing model from the issue text.