-
Notifications
You must be signed in to change notification settings - Fork 122
Issues: triton-inference-server/tensorrtllm_backend
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
lora_config shape mismatch when using converted LoRA at runtime
bug
Something isn't working
#750
opened May 16, 2025 by
paulhendricks
2 of 4 tasks
no /app folder in container nvcr.io/nvidia/tritonserver:24.12-trtllm-python-py3
bug
Something isn't working
#739
opened Apr 22, 2025 by
smennes
1 of 4 tasks
Vision Preprocessor Not Initialized for LLaVA in Triton Workflow
#737
opened Apr 18, 2025 by
oschleic
tensorrtllm_backend doesn't work with remote repos
bug
Something isn't working
#727
opened Mar 19, 2025 by
ShuaiShao93
4 tasks
build.sh
not able to run due to python dependency issues
#723
opened Mar 11, 2025 by
BenjaminBraunDev
Fail to test DraftTarget model with triton server tensorrtllm backend
bug
Something isn't working
#720
opened Mar 10, 2025 by
gloritygithub11
4 tasks
TensorRT-LLM Backend with multiple LLMs (not to be confused with multi-model)
#714
opened Feb 27, 2025 by
dduck999
Missing lookAheadRuntimeConfig in Triton Server with TensorRT-LLM backend HTTP Request
bug
Something isn't working
#711
opened Feb 18, 2025 by
shaylapid
2 of 4 tasks
Tritonserver Fails to Start with TensorRT-LLM Backend with lookahead_decoding mode - Assertion Failure in lookaheadDecodingLayer.cpp
bug
Something isn't working
#710
opened Feb 18, 2025 by
shaylapid
2 of 4 tasks
Failed to build TensorRT-LLM whisper Decoder
bug
Something isn't working
#707
opened Feb 14, 2025 by
muhammad-faizan-122
4 tasks
numpy.ndarray' object is not callable in gpt2/1/lib/triton_decoder.py", line 160, in convert_triton_request
bug
Something isn't working
#702
opened Feb 12, 2025 by
freedom-168
4 tasks
Mllama ignores input image when deployed in triton
bug
Something isn't working
#692
opened Feb 5, 2025 by
mutkach
2 of 4 tasks
Performance of triton+trtllm on llava-onevision compared to vllm and sglang
#689
opened Feb 3, 2025 by
alexemme
Previous Next
ProTip!
Follow long discussions with comments:>50.