AI Agents
SWE-agent
Give it a GitHub issue and it tries to fix the code for you - the original SWE-bench agent
★ 20.5k starsMIT
View guide →The benchmark that grades AI on real GitHub issues.
SWE-bench is an open-source ai agents project by SWE-bench (SWE-bench/SWE-bench on GitHub). It has 5,986 GitHub stars and 1,004 forks, is released under the MIT license, and was last updated on GitHub on 18 September 2026.
Pick one concrete task so you can judge whether the project fits.
Clone the repo and check the prerequisites listed in the README.
Install what it needs and configure credentials or model access.
Run a minimal example end to end before wiring it into your stack.
Built from genuine GitHub issues, not toy problems.
Widely cited for coding-agent evaluation.
Resolves are verified with real test suites.
Accompanied by published methodology.
Harness and datasets in Python.
Permissive licensing.
Install the SWE-bench package.
pip install swebenchPull the task instances you want to evaluate on.
# see docs for dataset optionsEvaluate a model per the documentation.
swebench --help
# see docs for eval commandsIt is maintained by the SWE-bench organization at SWE-bench/SWE-bench, with 1,004 forks.
Yes. It is released under the MIT license, which permits commercial use, modification, and redistribution. Read the LICENSE file for the exact terms.
Running evals needs model access and compute; the benchmark itself is free.
It targets real-world software engineering; compare with AgentBench or GPQA for different agent capabilities.
Read the paper and site docs, install the harness, and run a small evaluation.
Give it a GitHub issue and it tries to fix the code for you - the original SWE-bench agent
A benchmark for tool-agent-user interaction in real-world domains.
A benchmark testing whether agents can solve long-horizon coding tasks.
GitHub's official MCP server — let AI tools work with repos, issues and pull requests
Self-hosted AI vulnerability research: agents find, validate, deduplicate, and rank real security issues.
Benchmark computer-use agents on long, real-world desktop tasks.
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if SWE-bench is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.