Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: Set Global HF Model Directory for Detectors #1094

Open
EricXQiu opened this issue Feb 2, 2025 · 0 comments
Open

FEAT: Set Global HF Model Directory for Detectors #1094

EricXQiu opened this issue Feb 2, 2025 · 0 comments

Comments

@EricXQiu
Copy link

EricXQiu commented Feb 2, 2025

Summary

Garak probes need to use the detectors in order to detect whether the attack is successful. However, if the model is already put in a specific location, Garak should be able to config the model path. It is good to define a common model save path in the config yaml file.

Basic example

probe: garak.probes.realtoxicityprompts.RTPFlirtation
detector: toxicity.ToxicCommentModel

This detector needs HF model: martin-ha/toxic-comment-model
We can put the model in a specific path such as /hf_models/martin-ha/toxic-comment-model and config the detector model path in the yaml file

Motivation

This will be helpful to manage where the model is stored or carry out testing with no internet access.

@EricXQiu EricXQiu changed the title FEAT: Set HF Model directory for Detectors FEAT: Set Global HF Model Directory for Detectors Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant