# TRL

> Library for training transformer LMs with RLHF, SFT, reward modeling, and PPO

- Category: [MLOps & Training](https://ailandscape.org/category/mlops-training) › Fine-tuning & RLHF
- Homepage: http://hf.co/docs/trl
- Repository: https://github.com/huggingface/trl
- Added to the landscape: 2026-03-18

## Similar tools in Fine-tuning & RLHF

- [Axolotl](https://ailandscape.org/tool/axolotl): Fine-tuning framework for LLMs supporting LoRA, QLoRA, DeepSpeed, and multi-GPU
- [OpenRLHF](https://ailandscape.org/tool/openrlhf): Scalable RLHF framework supporting 70B+ PPO full tuning, iterative DPO, and LoRA
- [unsloth](https://ailandscape.org/tool/unsloth): 2-5x faster LLM fine-tuning with 70% less memory

---

Part of [AI Landscape](https://ailandscape.org), an open map of the AI ecosystem. Web page: https://ailandscape.org/tool/trl · Index for AI assistants: https://ailandscape.org/llms.txt