// agents · om-ai-lab/OmAgent

OmAgent

OmAgent é um projeto de agentes de IA de código aberto de om-ai-lab (om-ai-lab/OmAgent no GitHub). Tem 2.667 estrelas no GitHub e 291 forks, é publicado sob a licença Apache-2.0 e foi atualizado pela última vez no GitHub em 19 de março de 2025.

Python library for building multimodal language agents — VLM, video and mobile, fast to prototype and ship

★ 2,7 mil estrelas⑂ 291 forksApache-2.0atualizado mar 2025
▦ visual: o README deste projeto não inclui nenhuma captura incorporável,
então aqui vai um marcador. O guia abaixo está completo mesmo assim.
// dados do projeto

Dados do projeto

Repositório
om-ai-lab/OmAgent
Estrelas no GitHub
2.667
Forks
291
Licença
Apache-2.0
Última atualização no GitHub
19 de março de 2025
Categoria
Agentes de IA
Tipo de ficha
Guia de instalação completo
Site oficial
Official site
// como funciona

Como funciona

  1. Clarify your goal

    Pick a multimodal task — e.g. answering questions about a video, a visual QA web app, or a phone-connected assistant.

  2. Get OmAgent

    pip install omagent-core, or clone the repo to work from the examples.

  3. Install and configure

    Generate container.yaml for an example with compile_container.py, and set your LLM key/endpoint (or point it at a local Ollama model) in configs/llms.

  4. Run your first agent

    Run the simple VQA example's webpage demo and ask a question about an image.

// recursos

Por que as pessoas gostam tanto

Graph workflow engine

A flexible architecture with graph-based workflow orchestration and various memory types for contextual reasoning.

Native multimodality

Built-in support for VLM models, real-time APIs, computer vision models, video processing and mobile device connection.

Agent algorithms included

State-of-the-art unimodal and multimodal agent algorithms beyond simple LLM reasoning, e.g. ReAct, CoT and SC-CoT, packaged as reusable operators.

Local model support

Deploy your own models locally with Ollama or LocalAI instead of hosted APIs.

Distributed or Lite

A fully distributed architecture with custom scaling, or Lite mode that eliminates middleware deployment.

Worked examples

Video QA agent (Gradio app), mobile personal assistant, and an agentic-operators comparison project are included.

Advertisement
// execute você mesmo

Execute você mesmo

  1. Clone the repo

    Clone OmAgent to use its examples; the library itself installs from PyPI in step 2.

    git clone https://github.com/om-ai-lab/OmAgent.git
    cd OmAgent
  2. Install the library

    Install omagent_core from PyPI (Python >= 3.10).

    pip install omagent-core
  3. Run the VQA demo

    Generate the example config and launch the webpage demo on http://127.0.0.1:7860.

    cd examples/step1_simpleVQA
    python compile_container.py
    python run_webpage.py
// casos de uso

O que você pode criar

Advertisement
// perguntas frequentes

Perguntas frequentes

Who maintains OmAgent?

om-ai-lab maintains it; the framework paper is Zhang et al., 2024 (arXiv:2406.16620), presented in the EMNLP 2024 context.

Is OmAgent free?

Yes, Apache-2.0 licensed.

Does it need a paid API key?

Only if you choose a hosted LLM/VLM — set your OpenAI-compatible key in the config, or run local models with Ollama/LocalAI instead.

How does it compare to LangChain-style frameworks?

The authors aim for a simpler interface with less overhead, while natively covering multimodal inputs (video, vision, mobile) that text-first frameworks treat as add-ons.

How do I get started?

pip install omagent-core, then run the step1_simpleVQA example: compile_container.py, configure your LLM, and python run_webpage.py.

// continue explorando

Ferramentas semelhantes

Agentes de IA

rivet

Rivet is Ironclad's visual IDE and TypeScript library for building complex AI agents and prompt chains

★ 4,7 mil estrelasMIT
Ver o guia →
Agentes de IA

adk-python

Google's code-first toolkit for building real AI agents.

★ 21,7 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

MobileAgent

Mobile-Agent — multimodal GUI agents that operate phones and PCs from screenshots and instructions.

★ 9,3 mil estrelasMIT
Ver o guia →
Agentes de IA

antigravity-sdk-python

Google's Python SDK for building AI agents on the Antigravity platform and Gemini models.

★ 3,7 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

smolagents

smolagents — Hugging Face's barebones agent library where agents think in code: a CodeAgent that writes its actions as Python, model-agnostic, Apache-2.0

★ 29,9 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

agent-framework

A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.

★ 13,9 mil estrelasMIT
Ver o guia →
// alternativas

Alternativas em Agentes de IA

Os outros projetos de Agentes de IA com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se OmAgent não for o ideal para você.

// mais em agents

Mais em Agentes de IA

Projetos de Agentes de IA próximos no catálogo, os mais próximos em estrelas de OmAgent: continue explorando dos dois lados dele.

Baixe o OmAgent

Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.