ClawBench
An open benchmark for browser AI agents on everyday tasks.
WorkArena: ServiceNow's benchmark for how well web agents handle everyday knowledge-work tasks.
WorkArena is an open-source ai agents project by ServiceNow (ServiceNow/WorkArena on GitHub). It has 275 GitHub stars and 40 forks, is released under the NOASSERTION license, and was last updated on GitHub on 28 September 2026.
Decide whether you will evaluate on the atomic L1 tasks or the compositional WorkArena++ (L2/L3) tasks.
Request access to the gated WorkArena instances dataset on Hugging Face and authenticate your machine.
Install browsergym-workarena and Playwright into your BrowserGym environment.
Run the demo to see tasks solved by the oracle cheat functions, then wire your agent through env.step and validate its results.
WorkArena-L1 contains tens of thousands of unique instances across 33 tasks covering the main ServiceNow interface components.
Hundreds of composed tasks combine atomic skills into realistic use cases that test planning, reasoning, and memory.
Tasks run on actual ServiceNow instances rather than toy websites, reflecting real knowledge-work software.
The preferred evaluation path runs parallel experiments through BrowserGym with a unified public leaderboard.
Each task ships cheat (oracle) and validate functions, so you can see a task solved and then score your own agent against the same checks.
The benchmark is documented in ICML 2024 and NeurIPS 2024 papers linked from the repository.
Most evaluators install the package from PyPI into a BrowserGym environment.
git clone https://github.com/ServiceNow/WorkArena.git
cd WorkArenaFirst gain access to the gated instances dataset on Hugging Face and authenticate, as the README requires.
pip install browsergym-workarena
playwright installInstantiate tasks through BrowserGym's BrowserEnv and drive them with your agent via env.step, validating with the task's validate function. # see README live demo code
# see the README Live Demo section for the full BrowserEnv exampleIt is maintained by ServiceNow's research team.
The package is openly available, but the catalog metadata lists its license as NOASSERTION, and running it requires approved access to the gated ServiceNow instances dataset, so read the repository terms first.
No LLM key is needed for the benchmark itself; the agent you evaluate brings its own model access, and you need Hugging Face authentication for the gated instances.
WebArena tests agents on self-hosted web apps like shopping and forums; WorkArena tests them inside ServiceNow on enterprise knowledge-work tasks such as forms, catalogs, and dashboards.
Get approved for the instances dataset, pip install browsergym-workarena, install Playwright, and run the README's demo script through BrowserGym.
An open benchmark for browser AI agents on everyday tasks.
OSWorld — benchmark multimodal agents on open-ended tasks in real computer environments.
Simple desktop AI assistant with knowledge bases, agents, and web search.
An open-source, privacy-first, self-hosted knowledge workspace where humans and AI agents work together 开源、隐私优先、自托管的知识工作空间,让人与智能体在此协作
A benchmark testing whether agents can solve long-horizon coding tasks.
Benchmark computer-use agents on long, real-world desktop tasks.
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if WorkArena is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.