SDK for TEE AI Stick (includes model training script, inference library, examples)
-
Updated
Feb 15, 2019 - Python
#
inference-library
Here are 9 public repositories matching this topic...
Describing How to Enable OpenVINO Execution Provider for ONNX Runtime
deep-learning intel inference inference-engine inference-library onnx onnx-format onnx-backend openvino onnxruntime inference-api openvino-toolkit
-
Updated
Jun 29, 2020 - C++
Latte is a convolutional neural network (CNN) inference engine written in C++ and uses AVX to vectorize operations. The engine runs on Windows 10, Linux and macOS Sierra.
machine-learning caffe machine-learning-algorithms cnn avx python3 convolution machine-learning-library machinelearning convolutional-networks convolutional-neural-networks weight caffe-prototxt caffe-framework caffemodel inference-engine caffe-windows inference-library cnn-classification
-
Updated
Jun 25, 2018 - C++
Rust library managing long conversations with any LLM
-
Updated
Apr 8, 2025 - Rust
Unified JavaScript API for scoring via various DL framework
-
Updated
Oct 8, 2018 - Jupyter Notebook
Experimental Python implementation of OpenVINO Inference Engine (very slow, limited functionality). All codes are written in Python. Easy to read and modify.
python ai deep-learning experimental inference mnist mnist-classification convolution object-detection reference-implementation convolutional-neural-network inference-engine inference-library ssd-mobilenet openvino
-
Updated
Mar 11, 2022 - Python
NodeJS binding for Menoh DNN inference library
-
Updated
May 7, 2021 - JavaScript
Local Generative AI, unleashed. It signals a fundamental shift: no more cloud lock‑in or opaque black‑box services—now you run powerful generative AI models entirely on your own machine, giving you ultimate control over latency, privacy, and customization.
-
Updated
Apr 30, 2025
Improve this page
Add a description, image, and links to the inference-library topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the inference-library topic, visit your repo's landing page and select "manage topics."