Map / Core AI / Benchmarks & Leaderboards / LiveCodeBench Pro

LiveCodeBench Pro

Codeforces, ICPC, and IOI problems; regularly updated to prevent contamination

CuratedSoftware Engineering Benchmarks

I use this adds LiveCodeBench Pro to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses LiveCodeBench Pro or tried it.

Use LiveCodeBench Pro?

What it does

LiveCodeBench Pro is a competitive programming benchmark for language models built from Codeforces, ICPC and IOI problems, refreshed continuously to limit training-data contamination. Olympiad medalists annotate each problem by algorithm type. Its Python toolkit queries a model, extracts C++ solutions and judges them in a sandbox, and results are submitted by email to appear on the leaderboard.

Alternatives on the map

All 26 alternatives

Benchmarks & Leaderboards, starting with the other Software Engineering Benchmarks.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use LiveCodeBench Pro mark the rest of their stack, it shows up here.

Open website