Performance

Hello Community,
I'm using onnxruntime-genai for creating my application using phi3.5 onnx.
I have noticed that the genrator.append_tokens() function is taking around 1-1.5s to process. I wanna learn how to solve this issue as every milli second of latency is important for my application. I'm using python. Please let me know you need any further logs to solve this issue, i'm very happy to provide them

The issue names the Python generator.append_tokens() call and Phi-3.5 ONNX usage, but no source files or tests. Start by reproducing the reported 1–1.5 second latency with profiling and the requested logs; done means identifying the bottleneck and documenting or validating a measurable improvement.

Written by the indexing model from the issue text.