huggingface / huggingface/hf-agents

Feature request: Provide remote server config

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Shell
Stars
436
Forks
26
PR merge metrics
No merged PRs in 30d

Description

> hf agents run pi --help
> Error: 'llama-server' is required. Please install llama.cpp:
> https://github.com/ggml-org/llama.cpp/blob/master/docs/install.md

This project seems to be essentially openclaw, broken down into the individual pi agent, and a way to run it. That much is great, much more individual control.

However, openclaw can run a single agent, so this becomes useful when you DO want to run multiple agents, but isolated.

IF that's the intent, then it seems to make little sense for each one to run its own llama.cpp server instance. That would be super isolated, but super-inefficient: a centralised vllm or sglang instance that can serve many requests concurrently, or even a llama.cpp instance that can at least make use of good centralised hardware and serve concurrent requests reasonably well is a much better fit.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.