Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom Model "Serialization" #14

Open
mattjhawken opened this issue Dec 10, 2024 · 0 comments
Open

Custom Model "Serialization" #14

mattjhawken opened this issue Dec 10, 2024 · 0 comments
Labels
enhancement New feature or request torch PyTorch neural network workflow and optimizations.

Comments

@mattjhawken
Copy link
Member

Due to security risks and the potential of executing arbitrary code, serializing torch models with pickle is not implemented. Currently the only allowed models are those from Hugging Face and those that can be serialized via torch.jit.script.

The proposed custom model "serialization" method that can allow any model to be sent over P2P will involve using the inspect library to send the model source code to the worker. On the worker side, we must analyze the source code for vulnerabilities before then loading the model.

@mattjhawken mattjhawken added the enhancement New feature or request label Dec 10, 2024
@mattjhawken mattjhawken added the torch PyTorch neural network workflow and optimizations. label Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request torch PyTorch neural network workflow and optimizations.
Projects
None yet
Development

No branches or pull requests

1 participant