NVIDIA / NVIDIA/NemoClaw

Remote Ollama (self-hosted) support

Open
#1,060 3 comments 0 reactions 1 assignee Claimed by @ericksoa View on GitHub
area: inference area: install area: local-models area: onboarding area: providers needs: design provider: ollama UAT VDR
Dominant language
TypeScript
Stars
22.5k
Forks
3.1k
Avg merge
1d 1h
Merged PRs (30d)
715

Description

### Problem Statement

Currently Nemoclaw onboard is not presenting the option of remote Ollama (self-hosted) provider as it does not detect a local instance of Ollama.

Using an Open-ai compatible endpoint seems non-functional

Image

Image

Image

There are scenarios where a self hosted centralized LLM would be beneficial. At the moment there is a way to acomplish this by using `openshell provider create ` but it doesnt seem to be reliable.

### Proposed Design

Add an option in `nemoclaw onboard` such as Ollama(LAN) which would enable to easily configure lan based self-hosted Ollama.

### Alternatives Considered

_No response_

### Category

enhancement: provider

### Checklist

- [x] I searched existing issues and this is not a duplicate
- [x] This is a design proposal, not a "please build this" request

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.