Owner
triton-inference-server
12 indexed repositories · View on GitHub
-
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Python · 10996 stars
-
tensorrtllm_backend
The Triton TensorRT-LLM Backend
944 stars
-
client
Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
C++ · 701 stars
-
model_analyzer
Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv...
Python · 527 stars
-
onnxruntime_backend
The Triton backend for the ONNX Runtime.
C++ · 187 stars
-
Python · 160 stars
-
dali_backend
The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
C++ · 148 stars
-
fil_backend
FIL backend for the Triton Inference Server
C++ · 94 stars
-
triton_cli
Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen...
Python · 73 stars
-
openvino_backend
OpenVINO backend for Triton.
C++ · 39 stars
-
redis_cache
TRITONCACHE implementation of a Redis cache
C++ · 18 stars
-
local_cache
Implementation of a local in-memory cache for Triton Inference Server's TRITONCACHE API
C++ · 6 stars
-
Difficulty 3/5 1-2 days Newbie friendliness 70/100
triton-inference-server/server#8979 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
triton-inference-server/server#8978 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 78/100
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
triton-inference-server/server#8969 ·
-
Random latency regression on L40S nodes after new pod creation — node becomes persistently "bad" Openperformance
triton-inference-server/server#8947 · 10 comments · 1 assignee ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
triton-inference-server/server#8945 ·
-
Feature request: build an inference request once and reuse it across retries, without private APIs Open
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 3/5 1-2 days Newbie friendliness 68/100
triton-inference-server/server#8924 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 55/100
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
triton-inference-server/server#8922 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 76/100
triton-inference-server/server#8919 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
triton-inference-server/server#8912 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
triton-inference-server/server#8911 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
triton-inference-server/server#8906 ·
-
Difficulty 5/5 Over a week Newbie friendliness 45/100
triton-inference-server/server#8894 · 3 comments · 1 reaction ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
triton-inference-server/server#8884 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
triton-inference-server/server#8882 · 3 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 30/100
triton-inference-server/server#8877 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
triton-inference-server/server#8870 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 10/100
triton-inference-server/server#8865 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
triton-inference-server/server#8862 ·
-
Documentation documentation issue
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
triton-inference-server/server#8853 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
triton-inference-server/server#8852 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
triton-inference-server/server#8848 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
triton-inference-server/server#8843 ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
triton-inference-server/server#8841 · 1 comment ·
-
Python backend leaks disk: unpacked execution environments are never removed on model unload/reload Open
Difficulty 3/5 1-2 days Newbie friendliness 25/100
triton-inference-server/server#8840 · 2 comments ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
triton-inference-server/server#8839 ·
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
triton-inference-server/server#8838 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
triton-inference-server/server#8837 · 1 reaction ·
-
Difficulty 1/5 Under an hour Newbie friendliness 84/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 52/100
triton-inference-server/server#8824 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
triton-inference-server/server#8813 · 1 comment ·
-
Bug: cudnn_conv_algo_search silently ignored when configured via CUDA gpu_execution_accelerator Open
Difficulty 4/5 3-5 days Newbie friendliness 48/100
triton-inference-server/server#8808 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
triton-inference-server/server#8805 ·
-
[BUG] --http-header-forward-pattern has no effect on /generate endpoint (ensemble → Python backend) Open
triton-inference-server/server#8790 · 1 assignee ·
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
triton-inference-server/server#8781 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
triton-inference-server/server#8776 ·
-
bug Python Backend
Difficulty 4/5 3-5 days Newbie friendliness 48/100
triton-inference-server/server#8766 ·
-
SageMaker single-model endpoint returns 500 for empty-body POST to /invocations (should be 400) Open
Difficulty 3/5 1-2 days Newbie friendliness 58/100
triton-inference-server/server#8762 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
triton-inference-server/server#8755 ·
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 58/100
triton-inference-server/server#8754 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 64/100
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
triton-inference-server/server#8740 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
triton-inference-server/model_analyzer#1018 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
triton-inference-server/model_analyzer#1015 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 58/100
triton-inference-server/client#885 · 7 comments · 4 reactions ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
Showing the newest 100
This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.