simonw / simonw/llm

some log messages are getting output to stdout

Open
#196 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug help wanted
Dominant language
Python
Stars
12.5k
Forks
998
Avg merge
3d 13h
Merged PRs (30d)
10

Description

lines like "llama_new_context_with_model: max tensor size = 87.89 MB,," which are coming from the underlying C code are getting put into stdout instead of stderr.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the log output from the command-line application and trace how messages from the underlying C code are captured. Check whether the reported llama_new_context_with_model line reaches stdout or stderr, then verify that these messages are consistently emitted on stderr without changing other command output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.