mozilla / mozilla/bugbug

Redis error in the Docker Compose setup

Open
#5,420 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

http_service
Dominant language
Python
Stars
570
Forks
351
Avg merge
2d 13h
Merged PRs (30d)
65

Description

bugbug-http-service-bg-worker-1  | 2025-11-03 19:52:20,576:INFO:bugbug.repository:Analyzing seniorities from 3244 commits...
100%|██████████| 3244/3244 [00:00<00:00, 73312.30it/s]
bugbug-http-service-bg-worker-1  | 2025-11-03 19:52:20,624:INFO:bugbug.repository:Analyzing experiences from 3244 commits...
 21%|██        | 675/3244 [01:06<00:34, 75.40it/s]2025-11-03 19:53:27,097:WARNING:bugbug.repository:Experience missing for file mobile/android/focus-android/app/src/main/res/drawable/onboarding_second_screen_icon.png, type '', on commit d90855be218e898478597c0a49842f3a69916249
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:27,098:WARNING:bugbug.repository:Experience missing for file mobile/android/focus-android/app/src/main/res/drawable/onboarding_second_screen_icon.png, type 'backout', on commit d90855be218e898478597c0a49842f3a69916249
 49%|████▉     | 1599/3244 [01:18<00:13, 123.65it/s]2025-11-03 19:53:38,904:WARNING:bugbug.repository:Experience missing for file mobile/android/android-components/components/browser/domains/proguard-rules.pro, type '', on commit c0ac317234cf089a93ebe92e13783eb755e64db3
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:38,905:WARNING:bugbug.repository:Experience missing for file mobile/android/android-components/components/browser/domains/proguard-rules.pro, type 'backout', on commit c0ac317234cf089a93ebe92e13783eb755e64db3
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:38,906:WARNING:bugbug.repository:Experience missing for file mobile/android/android-components/components/browser/engine-gecko/src/test/resources/mockito-extensions/org.mockito.plugins.MockMaker, type '', on commit c0ac317234cf089a93ebe92e13783eb755e64db3
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:38,906:WARNING:bugbug.repository:Experience missing for file mobile/android/android-components/components/browser/engine-gecko/src/test/resources/mockito-extensions/org.mockito.plugins.MockMaker, type 'backout', on commit c0ac317234cf089a93ebe92e13783eb755e64db3
100%|██████████| 3244/3244 [01:32<00:00, 34.99it/s] 
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:59,121:INFO:bugbug.repository:Applying final commits filtering...
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:59,446:INFO:bugbug_http.boot:Commits DB updated.
bugbug-http-service-bg-worker-1  | 2025-11-03 19:53:59,446:INFO:bugbug_http.boot:Updating touched together DB...
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,490:INFO:bugbug_http.boot:Touched together DB updated.
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,491:INFO:bugbug_http.boot:Worker boot done
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,565:INFO:rq.worker:Worker ee03a1aeada445c59f8e81ba604d739b: started with PID 7, version 2.6.0
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,565:INFO:rq.worker:Worker ee03a1aeada445c59f8e81ba604d739b: subscribing to channel rq:pubsub:ee03a1aeada445c59f8e81ba604d739b
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,567:INFO:rq.worker:*** Listening on high, default, low...
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,567:INFO:rq.worker:Worker ee03a1aeada445c59f8e81ba604d739b: cleaning registries for queue: high
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,570:INFO:rq.worker:Worker ee03a1aeada445c59f8e81ba604d739b: cleaning registries for queue: default
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,575:WARNING:rq.registry:StartedJobRegistry cleanup: 830bc986c24440d6b28a5c32cd6ba83a Moved to FailedJobRegistry, due to AbandonedJobError, at 2025-11-03 19:54:57.575636+00:00
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,579:ERROR:rq.worker:Worker ee03a1aeada445c59f8e81ba604d739b: found an unhandled exception, quitting...
bugbug-http-service-bg-worker-1  | Traceback (most recent call last):
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1476, in _execute_transaction
bugbug-http-service-bg-worker-1  |     response = self.parse_response(connection, "_")
bugbug-http-service-bg-worker-1  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1546, in parse_response
bugbug-http-service-bg-worker-1  |     result = Redis.parse_response(self, connection, command_name, **options)
bugbug-http-service-bg-worker-1  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 651, in parse_response
bugbug-http-service-bg-worker-1  |     response = connection.read_response()
bugbug-http-service-bg-worker-1  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/connection.py", line 672, in read_response
bugbug-http-service-bg-worker-1  |     raise response
bugbug-http-service-bg-worker-1  | redis.exceptions.ExecAbortError: Transaction discarded because of previous errors.
bugbug-http-service-bg-worker-1  | 
bugbug-http-service-bg-worker-1  | During handling of the above exception, another exception occurred:
bugbug-http-service-bg-worker-1  | 
bugbug-http-service-bg-worker-1  | Traceback (most recent call last):
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/rq/worker.py", line 590, in work
bugbug-http-service-bg-worker-1  |     self.run_maintenance_tasks()
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/rq/worker.py", line 978, in run_maintenance_tasks
bugbug-http-service-bg-worker-1  |     self.clean_registries()
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/rq/worker.py", line 450, in clean_registries
bugbug-http-service-bg-worker-1  |     clean_registries(queue, self._exc_handlers)
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/rq/registry.py", line 619, in clean_registries
bugbug-http-service-bg-worker-1  |     ).cleanup(exception_handlers=exception_handlers)
bugbug-http-service-bg-worker-1  |       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/rq/registry.py", line 310, in cleanup
bugbug-http-service-bg-worker-1  |     pipeline.execute()
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1609, in execute
bugbug-http-service-bg-worker-1  |     return conn.retry.call_with_retry(
bugbug-http-service-bg-worker-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/retry.py", line 105, in call_with_retry
bugbug-http-service-bg-worker-1  |     return do()
bugbug-http-service-bg-worker-1  |            ^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1610, in <lambda>
bugbug-http-service-bg-worker-1  |     lambda: execute(conn, stack, raise_on_error),
bugbug-http-service-bg-worker-1  |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1479, in _execute_transaction
bugbug-http-service-bg-worker-1  |     raise errors[0][1]
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1469, in _execute_transaction
bugbug-http-service-bg-worker-1  |     self.parse_response(connection, "_")
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 1546, in parse_response
bugbug-http-service-bg-worker-1  |     result = Redis.parse_response(self, connection, command_name, **options)
bugbug-http-service-bg-worker-1  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/client.py", line 651, in parse_response
bugbug-http-service-bg-worker-1  |     response = connection.read_response()
bugbug-http-service-bg-worker-1  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^
bugbug-http-service-bg-worker-1  |   File "/usr/local/lib/python3.12/site-packages/redis/connection.py", line 672, in read_response
bugbug-http-service-bg-worker-1  |     raise response
bugbug-http-service-bg-worker-1  | redis.exceptions.ResponseError: Command # 7 (XADD rq:results:830bc986c24440d6b28a5c32cd6ba83a MAXLEN ~ 10 * type 2 worker_name exc_string...) of pipeline caused error: unknown command `XADD`, with args beginning with: `rq:results:830bc986c24440d6b28a5c32cd6ba83a`, `MAXLEN`, `~`, `10`, `*`, `type`, `2`, `worker_name`, ``, `exc_string`, `eJzzzS9LT`, 
bugbug-http-service-bg-worker-1  | 2025-11-03 19:54:57,584:INFO:rq.worker:Worker ee03a1aeada445c59f8e81ba604d739b: unsubscribing from channel rq:pubsub:ee03a1aeada445c59f8e81ba604d739b
bugbug-http-service-bg-worker-1 exited with code 0

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the Docker Compose setup and the Redis service used by the bg-worker, then reproduce the worker startup failure shown in the logs. Trace the Redis version or configuration involved in the missing XADD command; done means the worker starts and no longer exits with the Redis unknown-command error.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker-compose, python, redis
Domain
backend, devops
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.