Bogdanp / Bogdanp/dramatiq

Dramatiq workers hangs very often, no logs were seen in logs even if it is verbose mode.

Open
#578 12 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.3k
Forks
383
Avg merge
9h 41m
Merged PRs (30d)
2

Description

# Issues

GitHub issues are for bugs. If you have questions, please ask them on the [mailing list](https://groups.io/g/dramatiq-users/topics).

## Checklist

* [x] Does your title concisely summarize the problem?
* [x] Did you include a minimal, reproducible example?
* [x] What OS are you using?
* [x] What version of Dramatiq are you using?
* [x] What did you do?
* [x] What did you expect would happen?
* [x] What happened?

## What OS are you using?

Centos

## What version of Dramatiq are you using?

Dramatiq version 1.14.2

## What did you do?

Processing parallel async requests using dramatiq

## What did you expect would happen?

It should work properly it should receive messages and tasks, but it is getting hanged.

## What happened?

We are processing parallel async requests. It will work fine for 3 days and again the same issue occurs. If we restart the workers then it works , how to fix this

**dramatiq dramatiq_app.BatchOperationsDramatiqTasks --processes 1 --verbose**

I cant see anything in logs files. Even logs getting hanged

error which i captured when logs got hanged

`Exception in thread Thread-1:
Traceback (most recent call last):
File "/data/py3.9.7/lib/python3.9/[threading.py](https://threading.py/)", line 973, in _bootstrap_inner
[self.run](https://self.run/)()
File "/data/py3.9.7/lib/python3.9/[threading.py](https://threading.py/)", line 910, in run
self._target(*self._args, **self._kwargs)
File "/data/py3.9.7/Findly/lib/python3.9/site-packages/dramatiq/[cli.py](https://cli.py/)", line 328, in watch_logs
data = event.recv_bytes()
File "/data/py3.9.7/lib/python3.9/multiprocessing/[connection.py](https://connection.py/)", line 221, in recv_bytes
buf = self._recv_bytes(maxlength)
File "/data/py3.9.7/lib/python3.9/multiprocessing/[connection.py](https://connection.py/)", line 426, in _recv_bytes
return self._recv(size)
File "/data/py3.9.7/lib/python3.9/multiprocessing/[connection.py](https://connection.py/)", line 384, in _recv
chunk = read(handle, remaining)
MemoryError`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.