mudler / mudler/LocalAGI

Running on Mac systems

Open
#379 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
2k
Forks
291
Avg merge
30m
Merged PRs (30d)
3

Description

Can this run on a mac based system?

I splashed about a bit trying to get it to run but ultimately the models would fail to run since they couldn't gain access to the GPU on my macbook pro inside the docker container.

Since there are multiple components it tricky to get running outside the containers.

If it is possible it would be great if there was instructions on how to do it. I only see instructions for Intel, AMD and Nvidia card based systems.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start from the existing instructions for Intel, AMD, and Nvidia systems and review how the Docker containers handle model GPU access. Document a supported Mac setup, including any required differences between running in containers and outside them, and verify that the models can run as described on a Mac system.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, macos
Domain
documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.