This repo contains an example using pytest-benchmark to measure the latency of a simple torch model.
It was created as a companion for my blogpost Benchmarking Model Latency.
make setup-env
make simple-benchmark
to run the first example discussed in the blogpostmake parametrized-benchmark
to run the parametrized example and generate a .svg histogram