JavaScript is required to view the AI Landscape. Please enable JavaScript in your browser to explore the ecosystem.

The complete map of the AI ecosystemAI tools and frameworks mappedModels · Infrastructure · Product · SecurityOpen source landscape — contribute anytimeFilter, search, and compare tools instantlyDiscover the tools shaping the future of AIThe complete map of the AI ecosystemAI tools and frameworks mappedModels · Infrastructure · Product · SecurityOpen source landscape — contribute anytimeFilter, search, and compare tools instantlyDiscover the tools shaping the future of AI

Infrastructure

Inference & Compute

38 tools · 5 subcategories

Inference & Compute on AI Landscape covers 38 tools across 5 subcategories: Cloud & GPU Providers, Inference Optimization, Training Infrastructure, Compute & Hardware, Local & Edge Inference. Browse, compare, and discover what fits your stack.

Cloud & GPU Providers15

Akash Network

AWS Bedrock

AWS SageMaker

Azure ML

BentoML

Cloudflare AI

CoreWeave

Databricks

Google Vertex AI

Google Vertex AI

Heurist

Ray Serve

Seldon Core

TorchServe

Triton

Inference Optimization6

llama.cpp

ONNX Runtime

SGLang

TensorRT

vLLM

Training Infrastructure5

DeepSpeed

FSDP

Horovod

Megatron-LM

Nanotron

Compute & Hardware6

Cerebras WSE

CUDA

Groq LPU

ROCm

Tenstorrent

Local & Edge Inference6

FastChat

Harbor

LM Studio

ollama

Open WebUI

SillyTavern

← Back to the full landscape Suggest a tool for Inference & Compute →