mudler / mudler/LocalAI

omp gets no response from localai

Open
#11,928 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug unconfirmed
Dominant language
Go
Stars
49.2k
Forks
4.5k
Avg merge
1d 3m
Merged PRs (30d)
239

Description

LocalAI version:
LocalAI v4.9.0 (f7ad3f70eb5d8a0ddf80e08557f0d7df28cf032e)

Environment, CPU architecture, OS, and Version:

Describe the bug
If I send a request with oh my pi no answer get reported. weirdly the same prompt via the web ui has no problem.

To Reproduce

Expected behavior

Logs

log.txt

Additional context

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the attached log.txt and reproducing the same prompt through Oh My Pi and the web UI, comparing the two request paths. The issue is resolved when the Oh My Pi request receives a response under LocalAI v4.9.0 or the documented cause and affected behavior are identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
api, backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.