Map / Infrastructure / Inference & Compute

Inference & Compute

56 tools+ 3 community

The infrastructure layer that runs AI: GPU cloud providers, inference optimization libraries, distributed training infrastructure, purpose-built chips, and local LLM runtimes like llama.cpp and LM Studio. Renting compute? Compare the GPU clouds. Serving models in production? Start with vLLM and the inference optimizers. Running LLMs locally or at the edge? The local inference section covers runtimes and on-device tools. If it makes models run faster or cheaper, it's here.

Solid: curated by our editors.
Dashed: added by makers, not reviewed yet.
Seal: Verified maker.

Cloud & GPU Providers 16+ 2 community

Local & Edge Inference 12+ 1 community

MstyCommunity

Built something for Inference & Compute? Submit it and it appears here with a dashed edge. When an editor adds it to the map, it gets the solid one.

Submit a tool

Questions

How many Inference & Compute tools are there?

The map has 56 tools in Inference & Compute, plus 3 added by makers that are not reviewed yet, sorted into 5 sub-lines: Cloud & GPU Providers, Inference Optimization, Training Infrastructure, Compute & Hardware and Local & Edge Inference.

How does AI Landscape rank Inference & Compute?

By use, not votes: each member who marks a tool "I use this" counts once. Until enough members have marked them, the list here goes by sub-line and name. Editors place curated tools on the map; makers can submit their own, which appear with a dashed edge until reviewed.