huggingface / huggingface/optimum-nvidia

Segmentation fault: address not mapped to object at address 0xb1fe8

Open
#44 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
103
Avg merge
2m
Merged PRs (30d)
1

Description

```
root@af2909d04a8e:~# python test.py
[af2909d04a8e:755 :0:755] Caught signal 11 (Segmentation fault: address not mapped to object at address 0xb1fe8)
==== backtrace (tid: 755) ====
0 0x0000000000042520 __sigaction() ???:0
1 0x000000000018920a PyUnicode_Substring() ???:0
2 0x00000000001867f4 _PyCodec_Lookup() ???:0
3 0x000000000015350b _PyDict_NewPresized() ???:0
4 0x000000000014e8a2 _PyEval_EvalFrameDefault() ???:0
5 0x000000000016070c _PyFunction_Vectorcall() ???:0
6 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
7 0x000000000016070c _PyFunction_Vectorcall() ???:0
8 0x0000000000148f52 _PyEval_EvalFrameDefault() ???:0
9 0x000000000016e4e1 PyMethod_New() ???:0
10 0x000000000014e8a2 _PyEval_EvalFrameDefault() ???:0
11 0x000000000016e4e1 PyMethod_New() ???:0
12 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
13 0x000000000016070c _PyFunction_Vectorcall() ???:0
14 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
15 0x000000000016070c _PyFunction_Vectorcall() ???:0
16 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
17 0x000000000016070c _PyFunction_Vectorcall() ???:0
18 0x000000000015fb24 PyObject_CallFunctionObjArgs() ???:0
19 0x000000000023f4af _PyObject_CallMethodIdObjArgs() ???:0
20 0x00000000001740ca PyImport_ImportModuleLevelObject() ???:0
21 0x000000000014b9e5 _PyEval_EvalFrameDefault() ???:0
22 0x0000000000239e56 PyEval_EvalCode() ???:0
23 0x0000000000239cf6 PyEval_EvalCode() ???:0
24 0x000000000023fb0d PyFrozenSet_New() ???:0
25 0x0000000000160969 PyCell_New() ???:0
26 0x000000000014b2c1 _PyEval_EvalFrameDefault() ???:0
27 0x000000000016070c _PyFunction_Vectorcall() ???:0
28 0x000000000014e8a2 _PyEval_EvalFrameDefault() ???:0
29 0x000000000016070c _PyFunction_Vectorcall() ???:0
30 0x0000000000148f52 _PyEval_EvalFrameDefault() ???:0
31 0x000000000016070c _PyFunction_Vectorcall() ???:0
32 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
33 0x000000000016070c _PyFunction_Vectorcall() ???:0
34 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
35 0x000000000016070c _PyFunction_Vectorcall() ???:0
36 0x000000000015fb24 PyObject_CallFunctionObjArgs() ???:0
37 0x000000000023f4af _PyObject_CallMethodIdObjArgs() ???:0
38 0x00000000001740ca PyImport_ImportModuleLevelObject() ???:0
39 0x000000000014b9e5 _PyEval_EvalFrameDefault() ???:0
40 0x0000000000239e56 PyEval_EvalCode() ???:0
41 0x0000000000239cf6 PyEval_EvalCode() ???:0
42 0x000000000023fb0d PyFrozenSet_New() ???:0
43 0x0000000000160969 PyCell_New() ???:0
44 0x000000000014b2c1 _PyEval_EvalFrameDefault() ???:0
45 0x000000000016070c _PyFunction_Vectorcall() ???:0
46 0x000000000014e8a2 _PyEval_EvalFrameDefault() ???:0
47 0x000000000016070c _PyFunction_Vectorcall() ???:0
48 0x0000000000148f52 _PyEval_EvalFrameDefault() ???:0
49 0x000000000016070c _PyFunction_Vectorcall() ???:0
50 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
51 0x000000000016070c _PyFunction_Vectorcall() ???:0
52 0x0000000000148e0d _PyEval_EvalFrameDefault() ???:0
53 0x000000000016070c _PyFunction_Vectorcall() ???:0
54 0x000000000015fb24 PyObject_CallFunctionObjArgs() ???:0
55 0x000000000023f4af _PyObject_CallMethodIdObjArgs() ???:0
56 0x00000000001740ca PyImport_ImportModuleLevelObject() ???:0
=================================
```

I am running on Ubuntu 22.04 nvidia-docker with a 4090
`| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 |`

script:
```py
from optimum.nvidia.pipelines import pipeline

pipe = pipeline('text-generation', 'meta-llama/Llama-2-7b-chat-hf', use_fp8=True)
pipe("Describe a real-world application of AI in sustainable energy.")
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.