Can we add support for local LLMs? Or how would you recomend going about making the modifications?

Instead of using chat-gpt, I would like to try and use a local LLM. I am sure this would take some modifications, but I think we could potentially make this work, and would be an awesome addition to the plugin as local LLM's are surpassing gpt 3.5.

No files, tests, or entry points are named. Start by locating the plugin's existing OpenAI integration and reviewing the issue discussion for a concrete local-LLM interface; done would require an agreed scope and working support for a specified local backend.

Written by the indexing model from the issue text.