Discussions

• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v2.10.0

  narendasan started Feb 20, 2026 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Extending Pre-allocated Outputs to support reusing output buffers for intermediate TensorRT Engines

  narendasan started Dec 31, 2025 in RFCs

  

  

  0
• 1 You must be logged in to vote

  🙏

  Missing torch-tensorrt 2.4.0 package in the pytorch index

  GdoongMathew asked Dec 13, 2025 in Q&A · Answered

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  Ask for help about install pytorch/TensorRT from source special dependencies

  JohnHerry asked Dec 12, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  torch_tensorrt.save for aot_inductor format compatibility with PyTorch 2.10

  leimao started Nov 20, 2025 in General

  

  

  8
• 2 You must be logged in to vote

  #️⃣

  TorchTRT Compilation Memory Consumption Management

  narendasan started Sep 25, 2025 in RFCs

  

  

  

  

  9
• 1 You must be logged in to vote

  #️⃣

  Autocast and Weak Typing

  narendasan started Oct 16, 2025 in RFCs

  

  

  1
• 0 You must be logged in to vote

  💡

  LLM optimizations of Torch TensorRT

  cehongwang started Jul 31, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Dynamically Allocated Engines

  narendasan started Jul 24, 2025 in RFCs

  

  

  0
• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v2.7.0

  narendasan started May 7, 2025 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Complex number handling in Torch-TensorRT

  apbose started Apr 1, 2025 in RFCs

  

  

  8
• 1 You must be logged in to vote

  🙏

  torch.autograd.grad

  kudoryutaro asked Jun 13, 2023 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Automatic plugin generation using custom kernels and host code

  bowang007 started Oct 1, 2024 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Multi node support in Torch-TRT

  apbose started Aug 7, 2024 in RFCs

  

  

  4
• 1 You must be logged in to vote

  🙏

  Unable to use kwarg_inputs in torch_tensorrt.compile

  derMart asked Jan 23, 2025 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Support AOTInductor compilation and packaging with Torch-TensorRT modules

  peri044 started Nov 19, 2024 in RFCs

  

  

  3
• 1 You must be logged in to vote

  🙏

  Confuse about fast_partition and global_partition, what's diff between them?

  gavin838 asked Dec 16, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  #️⃣

  Support data dependent shapes (no fallback)

  bowang007 started Feb 28, 2023 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Building Refittable Engines by Default

  narendasan started Oct 2, 2024 in RFCs

  

  

  

  

  7
• 3 You must be logged in to vote

  🙏

  ❓ [Question] How do you convert part of the model to TRT?

  question Further information is requested

  MarekPokropinski asked Feb 18, 2022 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Support for loading multiple LORA adapters at runtime

  naiveen asked Feb 26, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  CUDAGraphs in Torch-TRT

  gs-olive started Apr 9, 2024 in RFCs

  

  

  

  

  2
• 1 You must be logged in to vote

  💬

  torch_tensorrt.dynamo.compile creates flawed output

  AIManifest started Aug 6, 2024 in General

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Engine Caching

  zewenli98 started Jun 26, 2024 in RFCs

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  Model Weight Refit

  cehongwang started Jun 7, 2024 in RFCs

  

  

  2