Issue with multiple consumers - re-delivering in progress jobs
还没有人认领这个 Issue。
- 主要语言
- PHP
- 星标
- 36
- 派生
- 22
- 平均合并
- 20 小时 36 分钟
- 30 天内合并 PR
- 2
描述
Hello,
I'm not sure if I have found a bug or if this just a case of user error.
I am having an issue with running multiple workers on long running jobs (~20 minutes).
When add a message into the queue and then start 2 workers using the following command
bin/cake worker -c process-invoices -p process-invoices
Initially, 1 worker will begin to process the job. However, after about 5 minutes, the other worker also begins to start working on the same job.
I have set $maxAttempts = 1 in the job class.
Next, I tried to bind each processor to an unique name
bin/cake worker -c process-invoices -p process-invoices1
and
bin/cake worker -c process-invoices -p process-invoices2
The message is only picked up by 1 worker, however if another message gets added to the queue, the other worker receives the following error:
[LogicException] Processor was not found. processorName: "process-invoices2" in /var/www/html/vendor/enqueue/enqueue/ArrayProcessorRegistry.php on line 33
And when I don't bind the processor name and run the following command twice to create 2 workers
bin/cake worker -c process-invoices
I receive a similar error:
error: [LogicException] Processor was not found. processorName: "Cake\Queue\Queue\Processor63e2a1884f1c4" in /var/www/html/vendor/enqueue/enqueue/ArrayProcessorRegistry.php on line 33
For reference, the config for the queue is:
'Queue' => [
'process-invoices' => [
'url' => null,
'queue' => 'process-invoices',
'logger' => 'stdout',
'receiveTimeout' => 10000,
'storeFailedJobs' => true,
],
],
I am unable to figure out a method of having multiple workers without the errors or re-processing jobs.
Is there any config setting (visibility timeout) that I am missing to resolve my issues?
Thanks!
贡献指南
这个仓库没有索引到贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
调研方向
首先,使用 process-invoices 配置和一个长时间运行的作业,通过两个 bin/cake worker 进程重现该问题。阅读 worker 入口点和报告的 ArrayProcessorRegistry.php 故障,然后比较使用唯一处理器名称和共享处理器名称时的行为。完成标准是多个 worker 可以处理队列中的作业,而不会发生重新投递或出现 Processor was not found 错误。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- php
- 领域
- backend, distributed-systems
- Issue 类型
- 缺陷
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 需要澄清
- 新手友好度
- 25/100