LlamaIndex alternatives in 2026: 24 tools like LlamaIndex

Closest: LLM Frameworks & RAG

DSPy

Framework for algorithmically optimizing LM prompts and pipelines

Curated

0 use thisCompare with LlamaIndex
Haystack

End-to-end NLP framework for LLM apps

Curated

0 use thisCompare with LlamaIndex
LangChain

Framework for developing LLM-powered applications

Curated

0 use thisCompare with LlamaIndex
Semantic Kernel

Microsoft's AI orchestration SDK; successor is Microsoft Agent Framework

Curated

0 use thisCompare with LlamaIndex
Spring AI

Spring framework for Java AI application development

Curated

0 use thisCompare with LlamaIndex

More in RAG & Memory

BGE Reranker

BAAI's high-performance multilingual reranker

Curated

0 use thisCompare with LlamaIndex
Cohere Rerank

Reranking models from Cohere for improving RAG relevance

Curated

0 use thisCompare with LlamaIndex
ColBERT

Late interaction retrieval model with token-level embeddings

Curated

0 use thisCompare with LlamaIndex
Jina Reranker

Multilingual reranker for improving RAG precision

Curated

0 use thisCompare with LlamaIndex
Sentence Transformers

Python framework for training and running embedding models

Curated

0 use thisCompare with LlamaIndex
Docling

Document conversion and parsing toolkit for gen AI pipelines

Curated

0 use thisCompare with LlamaIndex
LandingAI

APIs that extract structured data from documents, from Andrew Ng's company

CuratedWeb

0 use thisCompare with LlamaIndex
LlamaParse

Optimized document parsing for RAG by LlamaIndex

CuratedWeb

0 use thisCompare with LlamaIndex
Marker

Convert PDFs to markdown quickly and accurately

Curated

0 use thisCompare with LlamaIndex
Reducto

High-accuracy document extraction for complex PDFs

Curated

0 use thisCompare with LlamaIndex
Sarvam Vision

Document parsing model for Indian-language PDFs, forms and handwriting

CuratedWeb

0 use thisCompare with LlamaIndex
Unstructured

Document processing for RAG pipelines

Curated

0 use thisCompare with LlamaIndex
Upstage Document Parse

Converts complex documents into formats LLMs can read, plus data extraction

CuratedWeb

0 use thisCompare with LlamaIndex
Cognee

Semantic memory layer building knowledge graphs for AI agents

Curated

0 use thisCompare with LlamaIndex
Letta (MemGPT)

Platform for stateful agents with advanced memory that learns over time

Curated

0 use thisCompare with LlamaIndex
Mem0

Universal persistent memory layer for AI agents and assistants

Curated

0 use thisCompare with LlamaIndex
Supermemory

Memory and context API that gives AI agents long-term recall

Curated

0 use thisCompare with LlamaIndex
Zep

Temporal knowledge graph memory for agents (Graphiti)

Curated

0 use thisCompare with LlamaIndex
F

FlashRank

Ultra-lite cross-encoder reranking for RAG

Curated

0 use thisCompare with LlamaIndex

Questions

What are the closest alternatives to LlamaIndex?

DSPy, Haystack and LangChain sit on the same sub-line as LlamaIndex (LLM Frameworks & RAG) on AI Landscape, with 2 more.

How are these alternatives chosen?

They are the other products on the RAG & Memory stop of the map: curated products first, the ones on LlamaIndex's sub-line before the rest, then by name until members have marked enough of them.