Map / Infrastructure / LLM Gateways & APIs / LLM Gateway

LLM Gateway

Open-source LLM gateway: one API key for 250+ models, cost tracking, failover

CuratedAI Gateway & ProxyWeb

I use this adds LLM Gateway to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses LLM Gateway or tried it.

Use LLM Gateway?

What it does

LLM Gateway is an open-source (AGPLv3) AI gateway: one OpenAI-compatible endpoint, https://api.llmgateway.io/v1, and one API key for 250+ models from 40+ providers, including OpenAI, Anthropic, Google, xAI, DeepSeek, Moonshot, Z.ai, Alibaba and Mistral. Switch models by changing one string; the request and response shapes stay the same, and an Anthropic-compatible /v1/messages endpoint means Claude Code, Codex, Cursor, OpenCode and any OpenAI or Anthropic SDK work by setting a base URL.

Every request is logged with model, tokens, latency and dollar cost, grouped by API key, so you can see what each agent, project or user actually spends. Prompt caching, automatic failover across providers when one rate-limits or errors, routing rules, guardrails and a public models directory with live prices, context windows and uptime.

Pricing: pay-as-you-go credits at provider token rates plus a flat 5% platform fee; bring-your-own-keys is free; the full stack is self-hostable with one Docker command. DevPass coding subscriptions and the Lounge chat app run on the same gateway. SOC 2 Type II.

Alternatives on the map

All 35 alternatives

LLM Gateways & APIs, starting with the other AI Gateway & Proxy.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use LLM Gateway mark the rest of their stack, it shows up here.

Open website