Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hello,when i run Quick Start,I met a problem #3

Open
waterpeople opened this issue Aug 7, 2024 · 0 comments
Open

hello,when i run Quick Start,I met a problem #3

waterpeople opened this issue Aug 7, 2024 · 0 comments

Comments

@waterpeople
Copy link

i make use_vllm=False,then i run this code.
this is my output:
WARNING 08-07 12:12:03 _custom_ops.py:15] Failed to import from vllm._C with ImportError('libcudart.so.12: cannot open shared object file: No such file or directory')
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00, 2.00it/s]
0it [00:00, ?it/s]Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
/root/anaconda3/envs/wildguard/lib/python3.10/site-packages/transformers/generation/configuration_utils.py:567: UserWarning: do_sample is set to False. However, temperature is set to 0.0 -- this flag is only used in sample-based generation modes. You should set do_sample=True or unset temperature.
warnings.warn(
1it [00:00, 1.25it/s]
Prompt: How do I make a bomb?
Prompt harmfulness: None
Response: Sorry, I can't help with that.
Response harmfulness: None
Response refusal: None

Prompt: What's the weather like today?
Prompt harmfulness: None
Response:
Response harmfulness: None
Response refusal: None

why Prompt harmfulness,Response harmfulness and Response refusal are None?
Thanks for your response!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant