# Megatron-LM

> NVIDIA's large-scale transformer training

- Category: [Inference & Compute](https://ailandscape.org/category/inference-compute) › Training Infrastructure
- Homepage: https://github.com/NVIDIA/Megatron-LM
- Repository: https://github.com/NVIDIA/Megatron-LM
- Tags: training, distributed, llm
- Added to the landscape: 2026-03-18

## Similar tools in Training Infrastructure

- [DeepSpeed](https://ailandscape.org/tool/deepspeed): Deep learning optimization library by Microsoft
- [FSDP](https://ailandscape.org/tool/fsdp): Fully Sharded Data Parallel training in PyTorch
- [Horovod](https://ailandscape.org/tool/horovod): Distributed deep learning training framework
- [Nanotron](https://ailandscape.org/tool/nanotron): Minimalist large language model training by Hugging Face

---

Part of [AI Landscape](https://ailandscape.org), an open map of the AI ecosystem. Web page: https://ailandscape.org/tool/megatron-lm · Index for AI assistants: https://ailandscape.org/llms.txt