[Bug] 高并发下请求异常

### Checklist

- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

### Describe the bug

asyncio.exceptions.InvalidStateError: invalid state
Exception in callback >
handle:
Traceback (most recent call last):
File "uvloop/cbhandles.pyx", line 61, in uvloop.loop.Handle._run
File "/usr/local/lib/python3.10/site-packages/lmdeploy/turbomind/turbomind.py", line 415, in release
self.fut.set_result(None)
asyncio.exceptions.InvalidStateError: invalid state

### Reproduction

CUDA_VISIBLE_DEVICES=3 lmdeploy serve api_server /data/InternVL3-78B-AWQ --server-port 23334 --cache-max-entry-count 0.1 --session-len 5000

### Environment

```Shell
python 3.10
```

### Error traceback

```Shell

```