Shopify / Shopify/shipit-engine
sidekiq running out of memory
Nobody has claimed this yet.
- Dominant language
- Ruby
- Stars
- 1.5k
- Forks
- 154
- Avg merge
- 2h 26m
- Merged PRs (30d)
- 3
Description
Not sure if this is an issue with the backgroup job implementation on this project but I thought I'd see if anyone else is encountering this issue.
I'm running a shipit-based app in a docker-compose environment w/ latest ruby (2.3), and the the sidekiq process keeps running out of memory 'bundle exec sidekiq -C config/sidekiq.yml' I'm looking into it, and every time a new job is started 'refresh commits etc/'. the memory used by the bundle process increase and never comes back down. This happens with the built-in jobs triggered by 'refresh statuses and commits' button, as well as custom jobs I've written extending backgroundjob.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the memory growth with bundle exec sidekiq -C config/sidekiq.yml in the Docker Compose environment. Compare memory use while triggering the built-in “refresh statuses and commits” jobs and custom jobs extending backgroundjob. Done means the cause is identified and memory behavior is verified after jobs finish.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker-compose, ruby
- Domain
- backend
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100