Discussions

• 1 You must be logged in to vote

  🙏

  Best practice for an input pair <I_1, I,2>^0, ..., <I_1, I,2>^N

  shaked571 asked Apr 16, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is zero-scaling possible in Triton Server?

  kwanwoo02 asked Apr 5, 2023 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Inference with multiple backends?

  sabbih-shah asked Mar 26, 2023 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is there an http client which support stream?

  gaoxt1983 asked Mar 23, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Error when building grpc gcc11/ubuntu22.04?

  mgiessing asked Mar 20, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💡

  Possible higher level Python client API

  rgov started Mar 14, 2023 in Ideas

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to access inputs in TRITONSERVER_InferenceRequest

  avickars asked Mar 13, 2023 in Q&A · Closed · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Custom Batcher - more complicated batching

  MichalPitr asked Mar 13, 2023 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How to run the triton server cpu only on kubernetes?

  AlexXi19 asked Mar 13, 2023 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  I build a centos image by compiling the source code on mac m1 aarch 64, but the cmake compilation fails

  ltdo111 asked Mar 10, 2023 in Q&A · Closed · Answered

  

  

  2
• 0 You must be logged in to vote

  🙏

  Why I still perform inference while triton server is not ready?

  ptran1203 asked Mar 1, 2023 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  📣

  Triton version 2.31.0 corresponding to NGC container 23.02 is now Released!

  dzier announced Mar 1, 2023 in Announcements

  

  

  0
• 1 You must be logged in to vote

  🙏

  TRITON_ENABLE_METRICS_CPU not found

  xc724655471 asked Feb 27, 2023 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Installation guide for OpenShift

  jax79sg asked Feb 28, 2023 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is there a way to define models versions differently in the model repository?

  RafayAK asked Feb 24, 2023 in Q&A · Closed · Answered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Ensemble model with shared memory

  NikeNano asked Feb 24, 2023 in Q&A · Closed · Answered

  

  

  4
• 8 You must be logged in to vote

  📣

  New Tutorials for Triton Inference Server Now Available

  tanayvarshney announced Feb 27, 2023 in Announcements

  

  

  0
• 1 You must be logged in to vote

  🙏

  Use perf_client on models with string as input and variable shape

  ricard-borras-veriff asked Feb 24, 2023 in Q&A · Closed · Answered

  

  

  8
• 1 You must be logged in to vote

  🙏

  [Question] Setting the default input and output tensor names in the config.pbtxt

  keremyldrr asked Feb 24, 2023 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Unable to Connect to Triton Server at localhost:8000

  osuzdalev asked Feb 23, 2023 in Q&A · Closed · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  unexpected explicit tensor data for input tensor 'attention_mask' for model 'pipeline-poc-inference__isvc-211152d1e7' of type 'INT32', expected datatype 'INT64'

  MLHafizur asked Feb 22, 2023 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Use Encrypted ONNX model in Triton Server

  4BD0U asked Feb 20, 2023 in Q&A · Closed · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Suggestions for k8s_onprem helm chart

  okyspace started Feb 14, 2023 in Ideas

  

  

  1
• 11 You must be logged in to vote

  📣

  Welcome to Triton Inference Server Discussions!

  dzier announced Feb 23, 2023 in Announcements

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to use a fixed TensorRT version in triton server?

  question Further information is requested

  niuzheng168 asked Feb 16, 2023 in Q&A · Closed · Answered

  

  

  1