abetlen / abetlen/llama-cpp-python

TypeError: 'NoneType' object is not callable in __del__() when exiting

Aperta
#2,002 0 commenti 2 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
10.6k
Fork
1.4k
Metriche di merge delle PR
Metriche PR in attesa

Descrizione

# Prerequisites

- [x] I am running the latest code.
- [x] I followed the README.md.
- [x] I searched open/closed issues.
- [x] This is a reproducible error and fix.

# Expected Behavior

When the model is closed or Python exits, it should clean up resources quietly.

# Current Behavior

When using Llama(...), a crash occurs on exit:

TypeError: 'NoneType' object is not callable

This happens inside `__del__()` when it tries to close internal objects (e.g., ExitStack or model context) that are already `None`.

# Environment and Context

- Windows 11
- Python 3.11.3
- llama-cpp-python version: 0.3.8
- Using quantized GGUF model via `Llama(...)`

# Steps to Reproduce

1. Load model via `Llama(model_path=..., ...)`
2. Let script exit
3. Observe destructor crash in logs

# Recommended Fix

Wrap `close()` call in `__del__()` like so:

```python
def __del__(self):
try:
self.close()
except Exception:
pass

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.