Map / Infrastructure / LLM Gateways & APIs / LiteLLM

LiteLLM

Unified API gateway for 100+ LLM providers

CuratedAI Gateway & Proxy

I use this adds LiteLLM to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

1 use this

1use it now

0tried it, dropped it

0want to try

People who use it, last 8 weeks

Every mark here is self-reported.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses LiteLLM or tried it.

Use LiteLLM?

What it does

LiteLLM is an open-source Python SDK and self-hosted proxy server from BerriAI for calling many LLM providers through one OpenAI-format API. The proxy acts as an AI gateway for teams, adding virtual keys, budgets and rate limits, spend tracking, load balancing with retries and fallbacks, caching, guardrails, logging to observability tools and an admin dashboard.

Alternatives on the map

All 35 alternatives

LLM Gateways & APIs, starting with the other AI Gateway & Proxy.

Compare with

People who use it also use

Open website