Read more about ONNX Runtime Server here.
- golang
- grpc. Please be aware that the docs at "https://grpc.io/docs/quickstart/cpp/" is outdated, because building with make on UNIX systems is deprecated.
- re2
- cmake
- gcc and g++
- onnxruntime C API binaries. Please get it from github releases then extract it to your "/usr" or "/usr/local" folder.
See install_server_deps.sh for more details.
cd server
mkdir build
cmake -DCMAKE_BUILD_TYPE=Debug ..
make
ONNX Runtime Server supports sending logs to rsyslog daemon. To enable it, please run the cmake command with an additional parameter: -Donnxruntime_USE_SYSLOG=1
.