When will cuda12.5 && tritonserver 24.07-py3 be supported?

[dafu-wu]

Discussed in #2061

^{Originally posted by dafu-wu July 31, 2024}

[dev 2/10] RUN bash /tmp/install_tensorrt.sh && rm /tmp/install_tensorrt.sh:
#13 0.337 + TRT_VER=10.2.0.19
#13 0.337 + CUDA_VER=12.4
#13 0.337 + CUDNN_VER=9.1.0.70-1
#13 0.337 + NCCL_VER=2.21.5-1+cuda12.4
#13 0.337 + CUBLAS_VER=12.4.5.8-1
#13 0.337 + NVRTC_VER=12.4.127-1
#13 0.337 ++ nvcc --version
#13 0.343 + NVCC_VERSION_OUTPUT='nvcc: NVIDIA (R) Cuda compiler driver
#13 0.343 Copyright (c) 2005-2024 NVIDIA Corporation
#13 0.343 Built on Thu_Jun__6_02:18:23_PDT_2024
#13 0.343 Cuda compilation tools, release 12.5, V12.5.82
#13 0.343 Build cuda_12.5.r12.5/compiler.34385749_0'
#13 0.343 ++ echo nvcc: NVIDIA '(R)' Cuda compiler driver Copyright '(c)' 2005-2024 NVIDIA Corporation Built on Thu_Jun__6_02:18:23_PDT_2024 Cuda compilation tools, release 12.5, V12.5.82 Build cuda_12.5.r12.5/compiler.34385749_0
#13 0.343 ++ grep -oP '\d+.\d+'
#13 0.343 ++ head -n 1
#13 0.345 + [[ 12.5 != 12.4 ]]
#13 0.345 + echo 'The version of pre-installed CUDA is not equal to 12.4.'
#13 0.345 + exit 1
#13 0.345 The version of pre-installed CUDA is not equal to 12.4.

---

executor failed running [/bin/sh -c bash /tmp/install_tensorrt.sh && rm /tmp/install_tensorrt.sh]: exit code: 1