You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This issue is for tracking various features that could make running large-scale experiments more convenient. Unclear which ones are actually worth implementing, will probably add them over time whenever one seems like it would actually be helpful right now.
Allow loading a configuration from a yaml file.
Launcher for sweeps, ideally with Slurm integration. I was using the Hydra submitit plugin for this in an earlier version of this code base but then switched away from hydra. It clearly doesn't make sense to reimplement all of hydra's complexities, but we could for example just have a way of sweeping over experiment configs (previous point).
When training a detector, the type of anomaly (like what the backdoor trigger is) usually doesn't matter but you still need to specify it for no good reason.
Have an entrypoint function and register it with pip, so you can run cupbearer ... instead of python -m cupbearer.scripts...
Checkpointing
Make sure we don't accidentally overwrite files from previous run (e.g. check whether the output directory already exists)
The text was updated successfully, but these errors were encountered:
This issue is for tracking various features that could make running large-scale experiments more convenient. Unclear which ones are actually worth implementing, will probably add them over time whenever one seems like it would actually be helpful right now.
Allow loading a configuration from a yaml file.Launcher for sweeps, ideally with Slurm integration. I was using the Hydra submitit plugin for this in an earlier version of this code base but then switched away from hydra. It clearly doesn't make sense to reimplement all of hydra's complexities, but we could for example just have a way of sweeping over experiment configs (previous point).Have an entrypoint function and register it with pip, so you can runcupbearer ...
instead ofpython -m cupbearer.scripts...
The text was updated successfully, but these errors were encountered: