Map / Engineering / MLOps & Training / TRL

TRL

Library for training transformer LMs with SFT, RLHF, and reward modeling

CuratedFine-tuning & RLHFLinuxMacWindows

I use this adds TRL to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses TRL or tried it.

Use TRL?

What it does

TRL is Hugging Face's open-source library (Apache-2.0) for post-training transformer language models. It provides trainers for supervised fine-tuning, preference methods such as DPO and KTO, online reinforcement learning such as GRPO and RLOO, reward modelling and knowledge distillation, and works with Transformers, PEFT, Accelerate, DeepSpeed and vLLM to scale from one GPU to many nodes.

Alternatives on the map

All 46 alternatives

MLOps & Training, starting with the other Fine-tuning & RLHF.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use TRL mark the rest of their stack, it shows up here.

Open website