AOSSIE-Org / AOSSIE-Org/Devr.AI

ENHANCEMENT:Weaviate client connects and disconnects causing latency issues

Aperta
#227 2 commenti 0 reazioni 1 assegnatario Rivendicata da @vaishcodescape Vedi su GitHub
enhancement
Lingua principale
Python
Stelle
102
Fork
137
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

### Is there an existing issue for this?

- [x] I have searched the existing issues

### What happened?

## 📌 Issue Overview
The Weaviate backend client repeatedly connects and disconnects on every database operation instead of reusing a persistent connection, causing unnecessary performance overhead.

## 🔍 Root Cause
- `get_weaviate_client()` calls `await client.connect()` on entry and `await client.close()` on exit
- All Weaviate operations use `async with get_weaviate_client()`, triggering a full connect/disconnect cycle per request
- This occurs despite having a global client instance

## 🚨 Actual Behavior
- A new connection is established for **every** operation
- The connection is closed immediately after use
- No connection pooling or reuse
- Adds ~10–50ms latency per query
- Wastes resources and becomes a scalability bottleneck under load

```python
@asynccontextmanager
async def get_weaviate_client():
client = get_client()
try:
await client.connect() # connects every time
yield client
finally:
await client.close() # disconnects every time
```
## Record

- [x] I agree to follow this project's Code of Conduct
- [x] I want to work on this issue

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.