LibreAI / Agentes de IA / agent-desktop
// agents · lahfir/agent-desktop

agent-desktop

agent-desktop é um projeto de agentes de IA de código aberto de lahfir (lahfir/agent-desktop no GitHub). Tem 1.778 estrelas no GitHub e 127 forks, é publicado sob a licença Apache-2.0 e foi atualizado pela última vez no GitHub em 6 de outubro de 2026.

Reliable computer use for any agent: drive real apps through accessibility trees, not pixel guessing.

★ 1,8 mil estrelas⑂ 127 forksApache-2.0atualizado out 2026
▦ visual: o README deste projeto não inclui nenhuma captura incorporável,
então aqui vai um marcador. O guia abaixo está completo mesmo assim.
// dados do projeto

Dados do projeto

Estrelas no GitHub
1.778
Forks
127
Licença
Apache-2.0
Última atualização no GitHub
6 de outubro de 2026
Categoria
Agentes de IA
Tipo de ficha
Guia de instalação completo
// como funciona

Como funciona

  1. Clarify your goal

    Decide which desktop workflow your agent must perform and which apps it involves.

  2. Get the project

    Install agent-desktop globally from npm, or build it from source with cargo.

  3. Install and configure

    Grant macOS Accessibility permission (and Screen Recording if you need screenshots), using the built-in permission request command.

  4. Run your first task

    Take a snapshot of the target app, note element references, act on them, and re-snapshot to verify the result, optionally inside a traced session.

// recursos

Por que as pessoas gostam tanto

Accessibility-tree snapshots with stable refs

Snapshots return compact element references tied to a snapshot id, so agents act on identified controls rather than screen coordinates.

Progressive skeleton traversal

Dense apps can be explored through a shallow skeleton overview with targeted drill-down, which the project says cuts snapshot token use dramatically.

Headless-by-default interaction

Reference-based actions use accessibility APIs and avoid silently stealing focus, cursor, keyboard, or clipboard.

Broad command surface

Dozens of commands cover observation, interaction, keyboard, mouse, notifications, clipboard, window management, sessions, and trace export, all with structured JSON output.

Chromium interop via CDP

Launching a Chromium app with CDP opens a verified DevTools port so Playwright, Puppeteer, or agent-browser can drive web content while native UI stays on the accessibility path.

Sessions, traces, and FFI bindings

Shared sessions give multi-agent workflows a common snapshot namespace and JSONL traces exportable as a single HTML viewer, and a C-ABI library supports in-process use from many languages.

Advertisement
// execute você mesmo

Execute você mesmo

  1. Clone and build from source (alternative to npm)

    The npm install is the recommended route; source builds need Rust 1.89+ and macOS 13+.

    git clone https://github.com/lahfir/agent-desktop.git
    cd agent-desktop
    cargo build --release
  2. Install from npm and grant permissions

    The package downloads the prebuilt binary automatically.

    npm install -g agent-desktop
    agent-desktop permissions --request
  3. Snapshot and act

    List a Finder window's interactive elements, then click one by reference.

    agent-desktop snapshot --app Finder -i
    agent-desktop click @e3 --snapshot <snapshot_id>
// casos de uso

O que você pode criar

Advertisement
// perguntas frequentes

Perguntas frequentes

Who maintains it?

It is maintained by lahfir on GitHub.

Is it free to use?

Yes, it is Apache-2.0 licensed and free; the AI model that decides what to click comes from your own agent setup.

Does it need a paid API key?

Agent Desktop needs no API key; it is a local control tool. The agent driving it uses your existing model access.

How does it compare to a well-known alternative?

Screenshot-based computer use guesses coordinates from pixels and breaks when layouts shift; Agent Desktop reads the real accessibility tree and acts on stable element references that are safe to retry.

How do I get started?

Run npm install -g agent-desktop, grant Accessibility permission, then take your first snapshot with agent-desktop snapshot --app Finder -i.

// continue explorando

Ferramentas semelhantes

Agentes de IA

open-codex-computer-use

Open-source Computer Use as an MCP service: let any agent drive macOS, Linux, and Windows desktops.

★ 2,4 mil estrelasMIT
Ver o guia →
Agentes de IA

ESP32 iPhone Agent

ESP32 iPhone Agent — let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, no computer, no jailbreak

★ 2,4 mil estrelasMIT
Ver o guia →
Agentes de IA

OSWorld-V2

Benchmark computer-use agents on long, real-world desktop tasks.

★ 353 estrelasApache-2.0
Ver o guia →
Agentes de IA

mobile-use

AI agents that use real Android and iOS apps like a human — from minitap.

★ 3,2 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

pinvou-agent

Pinvou Agent — open-source desktop AI agent for tools, files, knowledge, workflows and real deliverables

★ 2,4 mil estrelasMIT
Ver o guia →
Agentes de IA

Jev Ultrafast

Jev Ultrafast — the fastest browser agent from browser-use: one decision-model request per action cycle drives a real browser, MIT

★ 23,7 mil estrelasMIT
Ver o guia →
// alternativas

Alternativas em Agentes de IA

Os outros projetos de Agentes de IA com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se agent-desktop não for o ideal para você.

// mais em agents

Mais em Agentes de IA

Projetos de Agentes de IA próximos no catálogo, os mais próximos em estrelas de agent-desktop: continue explorando dos dois lados dele.

Baixe o agent-desktop

Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.