HumanSignal / HumanSignal/label-studio-ml-backend

Timeout Error with ML Backend on AWS ECS

Open
#288 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
490
Avg merge
1d 14h
Merged PRs (30d)
3

Description

I am currently developing a custom ML Backend for active learning with Label Studio's enterprise version. I have managed to link my ML backend through AWS ECS. However, I am facing a timeout error while processing. The error message shows that the endpoint doesn't reply within the 3-second timeout limit. As my model employs a transformer architecture, processing frequently extends beyond 3 seconds.

![image](https://github.com/heartexlabs/label-studio-ml-backend/assets/32543382/6bd737e4-cf54-46ec-ad2e-7af8dd5a2873)

**Troubleshooting Steps Taken:**
After reviewing the logs thoroughly, I could not find any issues. The ML backend seems to be working fine, but the workflow is getting disrupted due to the timeout limitation.

**Request:**
I would like to increase the timeout length for the ML backend to accommodate the longer processing times required by my model. This will prevent the timeout error from occurring.

**Assistance Required:**
How can I extend the timeout length in Label Studio's enterprise version? Any information or configuration changes needed to achieve this would be greatly appreciated.

Thank you for your attention to this matter. I look forward to your response and assistance.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.