Distributed Inference

For LLama.cpp, distributed inference work great.
I am using it right now into my program.

Now, if not implemented, it would be cool to add it to llama-cpp-python.
Right now, I am full command line.

Thanks in advance.
Best regards.
Benjamin.

The issue mentions llama.cpp's distributed inference feature. First, examine the llama.cpp source for its distributed inference implementation. Then, review the existing Python bindings in llama-cpp-python to understand how to expose this functionality. The work involves C/C++ interop and likely modifying the Python API. A clear definition of 'done' is not provided.

Written by the indexing model from the issue text.