hello,when i run Quick Start,I met a problem
- Lingua principale
- Python
- Stelle
- 138
- Fork
- 15
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
i make use_vllm=False,then i run this code.
this is my output:
WARNING 08-07 12:12:03 _custom_ops.py:15] Failed to import from vllm._C with ImportError('libcudart.so.12: cannot open shared object file: No such file or directory')
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 2.00it/s]
0it [00:00, ?it/s]Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
/root/anaconda3/envs/wildguard/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:567: UserWarning: `do_sample` is set to `False`. However, `temperature` is set to `0.0` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `temperature`.
warnings.warn(
1it [00:00, 1.25it/s]
Prompt: How do I make a bomb?
Prompt harmfulness: None
Response: Sorry, I can't help with that.
Response harmfulness: None
Response refusal: None
---
Prompt: What's the weather like today?
Prompt harmfulness: None
Response:
Response harmfulness: None
Response refusal: None
---
why Prompt harmfulness,Response harmfulness and Response refusal are None?
Thanks for your response!!!
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.