simonw / simonw/llm

OSError on ARM (Linux/Debian) when running 'llm models' after installing llm-gpt4all

Open
#439 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
12.5k
Forks
998
Avg merge
3d 13h
Merged PRs (30d)
10

Description

Environment:

• Operating System: Debian GNU/Linux 6.6.15-arm64
• Architecture: aarch64
• Shell: bash
• Python Version: 3.11
• pipx Version: 1.3.4
• llm Version: 0.13.1

Reproduction Steps:

1 Install llm using pipx.
2 Run the command llm install llm-gpt4all.
3 Attempt to list models using llm models.

Expected Result: The llm models command should list available models without any errors.

Actual Result: An OSError is thrown indicating a missing shared object file:

OSError: /home/user/.local/share/pipx/venvs/llm/lib/python3.11/site-packages/gpt4all/llmodel_DO_NOT_MODIFY/build/libllama.so: cannot open shared object file: No such file or directory

Additional Information: The issue seems to be specific to the ARM architecture, as the shared object file libllama.so is either not present or not correctly built for ARM.

Steps to Resolve (without gpt4all):
pipx uninstall llm
pipx install llm

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue on Debian arm64 with Python 3.11 by installing llm-gpt4all through pipx and running llm models. Start by inspecting how the installed gpt4all package builds or locates libllama.so; done means the command lists available models without raising the missing shared-library OSError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, cli
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.