Support passing grammars to server on the command line.

未關閉

#636 建立於 2023年8月24日 0 則留言 4 個 reaction 已指派 0 人在 GitHub 檢視

enhancement

描述

**Is your feature request related to a problem? Please describe.**

The `python3 -m llama_cpp.server` command doesn't have a parameter to pass along a grammar the same way llama.cpp does.

**Describe the solution you'd like**

A `--grammar` command line parameter for the server.

Thanks!!

這個 Issue 還沒有評估資料。