Automation
taipy
Turns Data and AI algorithms into production-ready web applications in no time.
★ 19.4k starsApache-2.0
View guide →Benchmark suite for testing AI agents on realistic business workflows.
AutomationBench is an open-source automation project by zapier (zapier/AutomationBench on GitHub). It has 322 GitHub stars and 49 forks, is released under the Custom license, and was last updated on GitHub on 4 August 2026.
Get the tasks and harness from the repo.
Point the harness at the agent to evaluate.
Execute the realistic workflow tasks.
See where your agent stands.
Business workflows, not toy problems.
Measures what agents actually do.
From a company that lives on automation.
Standard tasks for fair comparison.
Useful for evals and papers.
Inspect how scoring works.
Download the source and move into the project folder.
git clone https://github.com/zapier/AutomationBench.git
cd AutomationBenchEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the project's launch command — Docker, pip, npm, or a binary release.
# see README for the exact launch commandRealistic business workflows; check the repo for the task list.
Custom license — read the repo's license file first.
Follow the harness integration docs in the repo.
No, it evaluates AI agents generally.
That is the goal of a standardized benchmark.
Turns Data and AI algorithms into production-ready web applications in no time.
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Full computer-use for AI agents on macOS — self-learning workflows, no screenshots.
Langflow — the visual builder for AI agents and workflows: drag-and-drop flows over LangChain components, deployed as APIs or MCP tools, MIT-licensed
Ready-made n8n workflows and AI agents to import, study, and adapt.
The most-starred other Automation projects in the LibreAI catalogue — the realistic shortlist if AutomationBench is not the right fit.
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+…
Langflow — the visual builder for AI agents and workflows: drag-and-drop flows over LangChain components, deployed as APIs or MCP tools, MIT-licensed
A curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows
Flowise — build AI agents visually: an open-source drag-and-drop UI over LangChain and LlamaIndex, with chatflows, agentflows and a marketplace of templates
Create agents that monitor and act on your behalf. Your agents are standing by!
Free and open — grab the source, star the repo, and start creating.