Limitations with output tokens that prevent detailed answers

Hello, I had raised this in the discussions but received no answers (link: https://github.com/llmware-ai/llmware/discussions/936#discussion-6966751). How can we ensure that answers aren't truncated baed not he maximum output tokens? Even if the tokens are set at 2000, the answers are truncated when using the bling-phi-3-gguf model (and I assume any other model dependent on llmware's apis). I tried multiple methods to change the maximum output tokens including passing it into the method to get the model as well as in the gguf config. Can someone please help. thanks!

Start with the linked discussion and reproduce the truncation using the bling-phi-3-gguf model with a 2000-token setting. Trace how llmware's model-loading API and GGUF configuration pass the output-token limit; the issue is done when the configured limit is honored or the supported constraint is documented.

Written by the indexing model from the issue text.