OSWorld-V2
Benchmark computer-use agents on long, real-world desktop tasks.
SWE-bench_Pro-os est un projet de agents IA open source, créé par scaleapi (scaleapi/SWE-bench_Pro-os sur GitHub). Il compte 539 étoiles sur GitHub et 101 forks, il est publié sous la licence MIT et a été mis à jour pour la dernière fois sur GitHub le 22 septembre 2026.
A benchmark testing whether agents can solve long-horizon coding tasks.
Decide what you want the project to do before installing anything.
Grab the source and skim the README for setup requirements.
Install dependencies and add any API keys or settings it needs.
Launch it and follow the example workflow from the docs.
Tasks beyond quick fixes.
Realistic software work.
Builds on a trusted benchmark.
From a leading data lab.
MIT licensed, inspectable.
Measures agents, not just models.
Download the source and move into the project folder.
git clone https://github.com/scaleapi/SWE-bench_Pro-os.git
cd SWE-bench_Pro-osCreate a virtual environment and install the requirements.
python -m venv .venv && source .venv/bin/activate
pip install -r requirements.txtTreat these as starting points - the README documents the exact commands.
python examples/quickstart.pyIt is an open-source project at scaleapi/SWE-bench_Pro-os with 101 forks. Check the repo's contributors and recent commits to judge how active maintenance is.
Yes - it is MIT licensed, so you can use, modify, and distribute it freely, including in commercial projects.
Running the evaluation is free; the model under test may use your own paid API keys.
Both test coding agents; SWE-bench Pro emphasizes long-horizon software engineering tasks in the SWE-bench tradition. Run both for a fuller picture.
Clone the repo, read the README's quickstart, and run the provided example - most projects get you to a first result in minutes.
Benchmark computer-use agents on long, real-world desktop tasks.
A control plane with a durable state kernel that keeps long-horizon agents moving across sessions.
The benchmark that grades AI on real GitHub issues.
An open benchmark for browser AI agents on everyday tasks.
WorkArena: ServiceNow's benchmark for how well web agents handle everyday knowledge-work tasks.
A self-improving agent for coding workflows and long-running autonomous tasks
Les autres projets de la catégorie Agents IA avec le plus d'étoiles du catalogue LibreAI — la sélection réaliste d'alternatives si SWE-bench_Pro-os ne vous convient pas.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Projets de la catégorie Agents IA proches dans le catalogue, les plus proches en étoiles de SWE-bench_Pro-os — continuez à explorer de part et d'autre.
A graduate-level benchmark even Google can't crack.
Detect prompt injections and jailbreaks before they hit your LLM.
Take multi-agent AutoGen workflows to production, fast.
Guardrails for building secure, robust agents.
A very large curated list of AI tools, updated for 2026.
Snowflake's Agent World Model: synthesise 1,000 executable MCP tool-use environments for agentic RL.
Gratuit et ouvert : récupérez le code source, mettez une étoile au dépôt et commencez à créer.