abetlen / abetlen/llama-cpp-python

TypeError: 'NoneType' object is not callable in __del__() when exiting

Open
#2,002 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

# Prerequisites

- [x] I am running the latest code.
- [x] I followed the README.md.
- [x] I searched open/closed issues.
- [x] This is a reproducible error and fix.

# Expected Behavior

When the model is closed or Python exits, it should clean up resources quietly.

# Current Behavior

When using Llama(...), a crash occurs on exit:

TypeError: 'NoneType' object is not callable

This happens inside `__del__()` when it tries to close internal objects (e.g., ExitStack or model context) that are already `None`.

# Environment and Context

- Windows 11
- Python 3.11.3
- llama-cpp-python version: 0.3.8
- Using quantized GGUF model via `Llama(...)`

# Steps to Reproduce

1. Load model via `Llama(model_path=..., ...)`
2. Let script exit
3. Observe destructor crash in logs

# Recommended Fix

Wrap `close()` call in `__del__()` like so:

```python
def __del__(self):
try:
self.close()
except Exception:
pass

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.