open-webui / open-webui/computer

bug: cptr stops incrementing context usage while llama.cpp reports differently

Open
#142 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
569
Forks
79
PR merge metrics
No merged PRs in 30d

Description

Hello,

I've discovered that the context size reported by llama.cpp and cptr differ, and for some reason cptr stops incrementing context usage.

Steps to reproduce:

  1. Run a workload that generates context using llama.cpp
  2. Monitor the context size reported by both llama.cpp and cptr
  3. Observe that cptr stops incrementing while llama.cpp continues to report increasing context usage
Image Image

Thank you for your time and help investigating this!

Best regards,
Joshua Krimmer

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the workload described in the issue and comparing context usage reported by llama.cpp with cptr over time. Trace the context-usage reporting path to find where cptr stops incrementing; done means cptr continues tracking the increasing usage consistently with llama.cpp.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.