Map / Engineering / Observability & Evals / DeepEval

DeepEval

Open-source LLM evaluation framework

CuratedLLM Evaluation & Benchmarking

I use this adds DeepEval to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses DeepEval or tried it.

Use DeepEval?

What it does

DeepEval is an open-source framework (Apache-2.0) from Confident AI for evaluating LLM applications and agents, with Python and TypeScript packages. Tests are written like unit tests and run under Pytest or Vitest, scoring outputs with metrics such as G-Eval, RAG metrics and task completion over full agent traces. Results stay local or can be sent to the Confident AI platform for monitoring.

Alternatives on the map

All 30 alternatives

Observability & Evals, starting with the other LLM Evaluation & Benchmarking.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use DeepEval mark the rest of their stack, it shows up here.

Open website