Map / Core AI / Benchmarks & Leaderboards / LiveCodeBench

LiveCodeBench

Holistic and contamination-free evaluation of large language models for code

CuratedSoftware Engineering Benchmarks

I use this adds LiveCodeBench to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses LiveCodeBench or tried it.

Use LiveCodeBench?

What it does

LiveCodeBench is a benchmark for code-capable language models from researchers at UC Berkeley, MIT and Cornell. It collects new problems from LeetCode, AtCoder and Codeforces contests and tags each with its release date, so a model can be scored only on problems published after its training cutoff. It covers code generation, self-repair, test output prediction and code execution.

Alternatives on the map

All 26 alternatives

Benchmarks & Leaderboards, starting with the other Software Engineering Benchmarks.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use LiveCodeBench mark the rest of their stack, it shows up here.

Open website