agent-desktop
Reliable computer use for any agent: drive real apps through accessibility trees, not pixel guessing.
Open-source Computer Use as an MCP service: let any agent drive macOS, Linux, and Windows desktops.
open-codex-computer-use is an open-source ai agents project by iFurySt (iFurySt/open-codex-computer-use on GitHub). It has 2,358 GitHub stars and 208 forks, is released under the MIT license, and was last updated on GitHub on 7 October 2026.
Decide which agent client (Codex, Claude Code, Gemini CLI, opencode, or your own MCP client) will drive the desktop.
Install the open-computer-use package globally from npm; it also provides the shorter ocu alias.
On macOS, launch it once and grant Accessibility and Screen Recording permissions; then install it into your agent using the matching install command or a manual MCP config entry.
Restart or reconnect your agent and ask it to perform a desktop task, or test a single tool call from the CLI first.
Exposes computer-use tools over MCP so any compatible agent or client can list apps, inspect app state, and act on the desktop.
Built-in commands write the right configuration for Codex, Claude Code, Gemini CLI, and opencode, plus a generic installer for other harnesses.
Runs on macOS, Linux, and Windows, building on OS accessibility features rather than purely visual clicking.
Call a single Computer Use tool from the CLI, evaluate JavaScript against the runtime, or keep a REPL session with reusable element state.
Run a sequence of calls in one process so element indexes stay valid between steps, with configurable pauses.
A doctor command checks permissions and setup, and a capabilities command reports runtime availability as JSON.
Most users install from npm, but the source checkout is here if you want it.
git clone https://github.com/iFurySt/open-codex-computer-use.git
cd open-codex-computer-useThis provides both open-computer-use and the ocu alias.
npm i -g open-computer-useWrite the MCP config for Codex automatically, then try listing apps.
open-computer-use install-codex-mcp
open-computer-use call list_appsIt is maintained by iFurySt as an open-source project inspired by OpenAI's Codex Computer Use.
Yes, it is MIT-licensed and free. You bring your own agent and model access through whichever MCP client you connect.
The tool itself needs no API key; the agent driving it (for example Codex or Claude Code) uses your existing account or key for that service.
OpenAI's Codex Computer Use is a closed, product-integrated feature; this project offers similar computer-use ability as an open MCP service you can attach to many different agents.
Run npm i -g open-computer-use, grant permissions on macOS, run the install command for your agent, and reconnect the agent.
Reliable computer use for any agent: drive real apps through accessibility trees, not pixel guessing.
ESP32 iPhone Agent — let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, no computer, no jailbreak
Snowflake's Agent World Model: synthesise 1,000 executable MCP tool-use environments for agentic RL.
An MCP integration platform that lets AI agents use tools reliably at any scale.
Osaurus — own your AI: a native macOS agent harness with any model, memory and fully offline execution.
Microsoft's GUI agent that grew into UFO³ — orchestrating agents across Windows, Linux and mobile devices.
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if open-codex-computer-use is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.