# FSDP

> Fully Sharded Data Parallel training in PyTorch

- Category: [Inference & Compute](https://ailandscape.org/category/inference-compute) › Training Infrastructure
- Homepage: https://pytorch.org/docs/stable/fsdp.html
- Tags: training, distributed, pytorch
- Added to the landscape: 2026-03-18

## Similar tools in Training Infrastructure

- [DeepSpeed](https://ailandscape.org/tool/deepspeed): Deep learning optimization library by Microsoft
- [Horovod](https://ailandscape.org/tool/horovod): Distributed deep learning training framework
- [Megatron-LM](https://ailandscape.org/tool/megatron-lm): NVIDIA's large-scale transformer training
- [Nanotron](https://ailandscape.org/tool/nanotron): Minimalist large language model training by Hugging Face

---

Part of [AI Landscape](https://ailandscape.org), an open map of the AI ecosystem. Web page: https://ailandscape.org/tool/fsdp · Index for AI assistants: https://ailandscape.org/llms.txt