[feature request] Add support/ template for llama.cpp compatible API endpoint.

It'd be great if someone can contribute a custom provider template/ full support for llama.cpp (i am using llama cpp python bindings) for the model support. Running it locally throws the API key error. Is there any way to bypass this?

No files or tests are identified in the issue. Start by reproducing the local setup with the llama.cpp Python bindings and trace where the API key error is produced. Done means the requested llama.cpp-compatible provider template or full support works locally without the erroneous API-key failure.

Written by the indexing model from the issue text.