Map / Core AI / Benchmarks & Leaderboards / Multi-SWE-bench

Multi-SWE-bench

Multilingual benchmark for issue resolving across multiple programming languages

CuratedSoftware Engineering Benchmarks

I use this adds Multi-SWE-bench to your stack and finds people with similar stacks. Every mark feeds the counts on Pulse. Sign in to mark it.

No ratings yet

Who uses it

0 use this

0use it now

0tried it, dropped it

0want to try

Nobody has marked it yet. Press I use this, Tried it or Want to try to be the first.

Ratings

Only from people who use it or tried it

No ratings yet

The first rating comes from someone who uses Multi-SWE-bench or tried it.

Use Multi-SWE-bench?

What it does

Multi-SWE-bench is a benchmark from ByteDance Seed for resolving real GitHub issues in languages beyond Python, covering Java, TypeScript, JavaScript, Go, Rust, C and C++. Each task pairs an issue with a repository and tests that a fix must pass. It has smaller mini and flash subsets for faster runs, a companion Multi-SWE-RL dataset for reinforcement learning, and a public leaderboard.

Alternatives on the map

All 26 alternatives

Benchmarks & Leaderboards, starting with the other Software Engineering Benchmarks.

Compare with

People who use it also use

Not enough marks yet to tell. When people who use Multi-SWE-bench mark the rest of their stack, it shows up here.

Open website