tensorrtllm_backend doesn't work with remote repos

[ShuaiShao93]

System Info

x86_64

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

It's documented here that triton supports remote repos.

However, this doesn't work with tensorrt-llm backend, because it requires to set explicit absolute engine_dir in the config.pbtxt. Can we make engine_dir default to the same directory? And also make tokenizer_dir of preprocessing/postprocessing default to tensorrt_llm as well

Expected behavior

engine_dir defaults to the same directory, or support relative path

actual behavior

engine_dir has to be absolute path

additional notes

N/A

[jadhosn]

Also interested