Map / Core AI / Benchmarks & Leaderboards / SWE-rebench

SWE-rebench

Continuously evolving and decontaminated benchmark for software engineering LLMs

CuratedSoftware Engineering Benchmarks

I use this adds SWE-rebench to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses SWE-rebench or tried it.

Use SWE-rebench?

What it does

SWE-rebench is a software engineering benchmark and leaderboard from Nebius that evaluates models and coding agents on fresh tasks mined automatically from real GitHub repositories. New tasks are added regularly and results are scored per time window, so models can be checked on problems created after their release to flag contamination. All models run in the same fixed scaffolding.

Alternatives on the map

All 26 alternatives

Benchmarks & Leaderboards, starting with the other Software Engineering Benchmarks.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use SWE-rebench mark the rest of their stack, it shows up here.

Open website