TensorRT-LLM

NVIDIA's LLM inference framework for NVIDIA GPUs with TensorRT acceleration

CuratedInference Optimization

I use this adds TensorRT-LLM to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses TensorRT-LLM or tried it.

Use TensorRT-LLM?

Inference & Compute, starting with the other Inference Optimization.

Not enough marks yet to tell. When people who use TensorRT-LLM mark the rest of their stack, it shows up here.