KI-Agenten
OSWorld-V2
Benchmark computer-use agents on long, real-world desktop tasks.
★ 353 SterneApache-2.0
Anleitung ansehen →SWE-bench_Pro-os ist ein Open-Source-Projekt aus der Kategorie KI-Agenten von scaleapi (scaleapi/SWE-bench_Pro-os auf GitHub). Es hat 539 Sterne auf GitHub und 101 Forks, wird unter der Lizenz MIT veröffentlicht und wurde zuletzt am 22. September 2026 auf GitHub aktualisiert.
A benchmark testing whether agents can solve long-horizon coding tasks.
Decide what you want the project to do before installing anything.
Grab the source and skim the README for setup requirements.
Install dependencies and add any API keys or settings it needs.
Launch it and follow the example workflow from the docs.
Tasks beyond quick fixes.
Realistic software work.
Builds on a trusted benchmark.
From a leading data lab.
MIT licensed, inspectable.
Measures agents, not just models.
Download the source and move into the project folder.
git clone https://github.com/scaleapi/SWE-bench_Pro-os.git
cd SWE-bench_Pro-osCreate a virtual environment and install the requirements.
python -m venv .venv && source .venv/bin/activate
pip install -r requirements.txtTreat these as starting points - the README documents the exact commands.
python examples/quickstart.pyIt is an open-source project at scaleapi/SWE-bench_Pro-os with 101 forks. Check the repo's contributors and recent commits to judge how active maintenance is.
Yes - it is MIT licensed, so you can use, modify, and distribute it freely, including in commercial projects.
Running the evaluation is free; the model under test may use your own paid API keys.
Both test coding agents; SWE-bench Pro emphasizes long-horizon software engineering tasks in the SWE-bench tradition. Run both for a fuller picture.
Clone the repo, read the README's quickstart, and run the provided example - most projects get you to a first result in minutes.
Benchmark computer-use agents on long, real-world desktop tasks.
A control plane with a durable state kernel that keeps long-horizon agents moving across sessions.
The benchmark that grades AI on real GitHub issues.
An open benchmark for browser AI agents on everyday tasks.
WorkArena: ServiceNow's benchmark for how well web agents handle everyday knowledge-work tasks.
A self-improving agent for coding workflows and long-running autonomous tasks
Die anderen Projekte der Kategorie KI-Agenten mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls SWE-bench_Pro-os nicht das Richtige ist.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Verwandte Projekte der Kategorie KI-Agenten im Katalog, die SWE-bench_Pro-os bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
A graduate-level benchmark even Google can't crack.
Detect prompt injections and jailbreaks before they hit your LLM.
Take multi-agent AutoGen workflows to production, fast.
Guardrails for building secure, robust agents.
A very large curated list of AI tools, updated for 2026.
Snowflake's Agent World Model: synthesise 1,000 executable MCP tool-use environments for agentic RL.
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.