# NVIDIA Dynamo

> Distributed inference serving framework for LLMs on GPU clusters

- Category: [Inference & Compute](https://ailandscape.org/category/inference-compute) › Inference Optimization
- Homepage: https://docs.nvidia.com/dynamo/latest
- Repository: https://github.com/ai-dynamo/dynamo
- Tags: inference, llm, distributed, nvidia
- Added to the landscape: 2026-10-09

## Similar tools in Inference Optimization

- [BentoML](https://ailandscape.org/tool/bentoml): Framework for building ML-powered services
- [llama.cpp](https://ailandscape.org/tool/llama-cpp): LLM inference in C/C++ for local deployment
- [llm-d](https://ailandscape.org/tool/llm-d): Kubernetes-native distributed LLM inference stack
- [NVIDIA Dynamo-Triton](https://ailandscape.org/tool/nvidia-dynamo-triton): NVIDIA open-source inference serving software
- [ONNX Runtime](https://ailandscape.org/tool/onnx-runtime): Cross-platform ML model accelerator
- [Ray Serve](https://ailandscape.org/tool/ray-serve): Scalable model serving with Ray
- [Seldon Core](https://ailandscape.org/tool/seldon-core): Kubernetes-native ML deployment platform
- [SGLang](https://ailandscape.org/tool/sglang): Fast serving framework for LLMs and VLMs with structured generation support

---

Part of [AI Landscape](https://ailandscape.org), an open map of the AI ecosystem. Web page: https://ailandscape.org/tool/nvidia-dynamo · Index for AI assistants: https://ailandscape.org/llms.txt