microsoft onnxruntime-genai Discussions
Pinned Discussions
Discussions
-
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote cannot build phi2 model on system with 32 GB ram
enhancementNew feature or request -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote Support scenarios where inputs_embeds is a model input
enhancementNew feature or request -
You must be logged in to vote Improve performance for quantized models on Power10 CPU
enhancementNew feature or request -
You must be logged in to vote -
You must be logged in to vote Is there a plan to support running Phi3 on the NPU of the Core Ultra
enhancementNew feature or request -
You must be logged in to vote Regex decoding support
enhancementNew feature or request -
You must be logged in to vote Extend GeneratorParams.SetSearchOption to allow setting strings
enhancementNew feature or request -
You must be logged in to vote Wasm/WebGPU backends?
enhancementNew feature or request -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote -
You must be logged in to vote
