prometheus / prometheus/client_ruby

CPU usage growing over time with DirectFileStore

Open
#232 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Ruby
Stars
558
Forks
154
PR merge metrics
No merged PRs in 30d

Description

We've got an issue on our application where the CPU usage will slowly grow over time (eventually getting to 100%, unless we reboot the app to bring it back down):

cpu-load

We're using the DirectFileStore and find that if we clear the bin files manually (as is done on app boot) the CPU usage immediately drops off a cliff:

Screenshot 2021-07-19 at 10 29 18

No issues with memory usage. Any thoughts on what could be causing this?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the CPU growth with DirectFileStore and compare behavior before and after clearing the bin files, as described in the issue. Trace the DirectFileStore and application-boot cleanup paths; done means identifying the cause and demonstrating that CPU usage no longer grows over time without a reboot.

Written by the indexing model from the issue text.

Assessment

Tech stack
ruby
Domain
observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.