LibreAI / Agentes de IA / agent-desktop
// agents · lahfir/agent-desktop

agent-desktop

agent-desktop es un proyecto de agentes de IA de código abierto de lahfir (lahfir/agent-desktop en GitHub). Tiene 1.778 estrellas en GitHub y 127 bifurcaciones, se publica bajo la licencia Apache-2.0 y se actualizó por última vez en GitHub el 6 de octubre de 2026.

Reliable computer use for any agent: drive real apps through accessibility trees, not pixel guessing.

★ 1,8k estrellas⑂ 127 bifurcacionesApache-2.0actualizado oct 2026
▦ visual: el README de este proyecto no incluye ninguna captura incrustable,
así que aquí va un marcador. La guía de abajo está completa de todos modos.
// datos del proyecto

Datos del proyecto

Estrellas en GitHub
1.778
Bifurcaciones
127
Licencia
Apache-2.0
Última actualización en GitHub
6 de octubre de 2026
Categoría
Agentes de IA
Tipo de ficha
Guía de instalación completa
// cómo funciona

Cómo funciona

  1. Clarify your goal

    Decide which desktop workflow your agent must perform and which apps it involves.

  2. Get the project

    Install agent-desktop globally from npm, or build it from source with cargo.

  3. Install and configure

    Grant macOS Accessibility permission (and Screen Recording if you need screenshots), using the built-in permission request command.

  4. Run your first task

    Take a snapshot of the target app, note element references, act on them, and re-snapshot to verify the result, optionally inside a traced session.

// características

Por qué gusta tanto

Accessibility-tree snapshots with stable refs

Snapshots return compact element references tied to a snapshot id, so agents act on identified controls rather than screen coordinates.

Progressive skeleton traversal

Dense apps can be explored through a shallow skeleton overview with targeted drill-down, which the project says cuts snapshot token use dramatically.

Headless-by-default interaction

Reference-based actions use accessibility APIs and avoid silently stealing focus, cursor, keyboard, or clipboard.

Broad command surface

Dozens of commands cover observation, interaction, keyboard, mouse, notifications, clipboard, window management, sessions, and trace export, all with structured JSON output.

Chromium interop via CDP

Launching a Chromium app with CDP opens a verified DevTools port so Playwright, Puppeteer, or agent-browser can drive web content while native UI stays on the accessibility path.

Sessions, traces, and FFI bindings

Shared sessions give multi-agent workflows a common snapshot namespace and JSONL traces exportable as a single HTML viewer, and a C-ABI library supports in-process use from many languages.

Advertisement
// ejecútalo

Ejecútalo tú mismo

  1. Clone and build from source (alternative to npm)

    The npm install is the recommended route; source builds need Rust 1.89+ and macOS 13+.

    git clone https://github.com/lahfir/agent-desktop.git
    cd agent-desktop
    cargo build --release
  2. Install from npm and grant permissions

    The package downloads the prebuilt binary automatically.

    npm install -g agent-desktop
    agent-desktop permissions --request
  3. Snapshot and act

    List a Finder window's interactive elements, then click one by reference.

    agent-desktop snapshot --app Finder -i
    agent-desktop click @e3 --snapshot <snapshot_id>
// casos de uso

Qué puedes crear

Advertisement
// preguntas frecuentes

Preguntas frecuentes

Who maintains it?

It is maintained by lahfir on GitHub.

Is it free to use?

Yes, it is Apache-2.0 licensed and free; the AI model that decides what to click comes from your own agent setup.

Does it need a paid API key?

Agent Desktop needs no API key; it is a local control tool. The agent driving it uses your existing model access.

How does it compare to a well-known alternative?

Screenshot-based computer use guesses coordinates from pixels and breaks when layouts shift; Agent Desktop reads the real accessibility tree and acts on stable element references that are safe to retry.

How do I get started?

Run npm install -g agent-desktop, grant Accessibility permission, then take your first snapshot with agent-desktop snapshot --app Finder -i.

// sigue explorando

Herramientas similares

Agentes de IA

open-codex-computer-use

Open-source Computer Use as an MCP service: let any agent drive macOS, Linux, and Windows desktops.

★ 2,4k estrellasMIT
Ver la guía →
Agentes de IA

ESP32 iPhone Agent

ESP32 iPhone Agent — let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, no computer, no jailbreak

★ 2,4k estrellasMIT
Ver la guía →
Agentes de IA

OSWorld-V2

Benchmark computer-use agents on long, real-world desktop tasks.

★ 353 estrellasApache-2.0
Ver la guía →
Agentes de IA

mobile-use

AI agents that use real Android and iOS apps like a human — from minitap.

★ 3,2k estrellasApache-2.0
Ver la guía →
Agentes de IA

pinvou-agent

Pinvou Agent — open-source desktop AI agent for tools, files, knowledge, workflows and real deliverables

★ 2,4k estrellasMIT
Ver la guía →
Agentes de IA

Jev Ultrafast

Jev Ultrafast — the fastest browser agent from browser-use: one decision-model request per action cycle drives a real browser, MIT

★ 23,7k estrellasMIT
Ver la guía →
// alternativas

Alternativas en Agentes de IA

Los demás proyectos de Agentes de IA con más estrellas del catálogo de LibreAI: la lista realista de alternativas si agent-desktop no es lo que buscas.

// más en agents

Más en Agentes de IA

Proyectos de Agentes de IA cercanos en el catálogo, los más próximos en estrellas a agent-desktop: sigue explorando a ambos lados.

Consigue agent-desktop

Gratis y abierto: consigue el código fuente, dale una estrella al repositorio y empieza a crear.