vllm-project / vllm-project/aibrix

Why is there no ModelAdapterFailed status when loading LoRA?

Open
#1,860 5 comments 1 reaction 1 assignee Claimed by @Jeffwan View on GitHub
area/lora kind/bug
Dominant language
Go
Stars
5.1k
Forks
697
Avg merge
1d 19h
Merged PRs (30d)
104

Description

### 🐛 Describe the bug

When load the LoRA model, LoRA keeps retrying, but the status does not change to "failed."
Reviewed the code and found that in the reconcileLoading function, even after the pod retries 5 times, the status is not set to failed.

### Steps to Reproduce

1. aibrix 0.5.0

### Expected behavior

After a certain number of retries, if it still fails, the status is set to failed.

### Environment

1. aibrix 0.5.0

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.