Skip to content

Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.

License

Notifications You must be signed in to change notification settings

sachanub/sagemaker-pytorch-inference-toolkit

 
 

Repository files navigation

SageMaker PyTorch Inference Toolkit

SageMaker PyTorch Inference Toolkit is an open-source library for serving PyTorch models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain PyTorch model types and is responsible for starting up the TorchServe model server on SageMaker, which is responsible for handling inference requests.

For training, see SageMaker PyTorch Training Toolkit.

For the Dockerfiles used for building SageMaker PyTorch Containers, see AWS Deep Learning Containers.

For information on running PyTorch jobs on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.

For notebook examples: SageMaker Notebook Examples.

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

License

SageMaker PyTorch Serving Container is licensed under the Apache 2.0 License. It is copyright 2018 Amazon .com, Inc. or its affiliates. All Rights Reserved. The license is available at: http://aws.amazon.com/apache2.0/

About

Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%