// agents · openvla/openvla

openvla

openvla é um projeto de agentes de IA de código aberto de openvla (openvla/openvla no GitHub). Tem 7.123 estrelas no GitHub e 854 forks, é publicado sob a licença MIT e foi atualizado pela última vez no GitHub em 23 de março de 2025.

Open-source 7B vision-language-action model and codebase for generalist robot manipulation.

★ 7,1 mil estrelas⑂ 854 forksMITatualizado mar 2025
▦ visual: o README deste projeto não inclui nenhuma captura incorporável,
então aqui vai um marcador. O guia abaixo está completo mesmo assim.
// dados do projeto

Dados do projeto

Repositório
openvla/openvla
Estrelas no GitHub
7.123
Forks
854
Licença
MIT
Última atualização no GitHub
23 de março de 2025
Categoria
Agentes de IA
Tipo de ficha
Guia de instalação completo
// como funciona

Como funciona

  1. Check your hardware first

    Inference and LoRA fine-tuning need a capable NVIDIA GPU; the README's LoRA example uses a single A100 80GB, and smaller GPUs down to roughly 27GB can work with reduced batch sizes.

  2. Install for inference or training

    For inference, install the minimal requirements and load the checkpoint through Hugging Face transformers; for training, create the conda environment and install the repo editable.

  3. Run zero-shot inference

    Load openvla/openvla-7b with the AutoProcessor, pass a camera image and an instruction prompt, and read out an action with predict_action.

  4. Fine-tune on your robot

    Download a BridgeData V2 or other Open X-Embodiment dataset in RLDS format (or convert your own), then run the LoRA fine-tuning script - or the newer OFT recipe the project now recommends.

// recursos

Por que as pessoas gostam tanto

Flagship 7B checkpoint

openvla-7b is trained on a mixture of Open X-Embodiment datasets spanning 970K trajectories, with checkpoints, configs and model cards on Hugging Face.

Minimal-dependency inference

A lightweight transformers interface (AutoProcessor and AutoModelForVision2Seq) loads the model with few dependencies, and a REST API serving script is included for robot stacks without on-device compute.

LoRA and full fine-tuning

Built-in examples cover full, partial and (quantized) LoRA fine-tuning via Hugging Face PEFT, plus full fine-tuning with PyTorch FSDP for multi-GPU nodes.

Scales from 1B to 34B

PyTorch FSDP and Flash-Attention power training across model sizes, with native support for arbitrary RLDS dataset mixtures.

FAST action tokenizer support

The project documents the FAST tokenizer, which compresses action chunks into fewer tokens for much faster inference with discrete actions.

OFT fine-tuning recipe

The 2025 OFT update offers an optimized fine-tuning recipe the team recommends for faster inference, higher success rates, multiple input images and high-frequency bimanual control.

Advertisement
// execute você mesmo

Execute você mesmo

  1. Clone the repository

    Clone the OpenVLA codebase for the training, fine-tuning and serving scripts.

    git clone https://github.com/openvla/openvla.git
    cd openvla
  2. Create the environment and install

    Set up the pinned Python 3.10 / PyTorch 2.2 environment from the README, then install the package editable.

    conda create -n openvla python=3.10 -y
    conda activate openvla
    pip install -e .
  3. Load the model for inference

    Install the minimal requirements and load openvla-7b in a few lines of Python.

    pip install -r https://raw.githubusercontent.com/openvla/openvla/main/requirements-min.txt
    python -c "from transformers import AutoProcessor; AutoProcessor.from_pretrained('openvla/openvla-7b', trust_remote_code=True)"  # see README for the full inference example
// casos de uso

O que você pode criar

Advertisement
// perguntas frequentes

Perguntas frequentes

Who maintains OpenVLA?

The OpenVLA project team maintains the repository; it is built on the Prismatic VLMs codebase and released alongside the OpenVLA research paper.

Is OpenVLA free to use?

The code is MIT-licensed. The pretrained checkpoints are derived from Llama-2, so their use is governed by the Llama Community License rather than MIT - check its terms before commercial deployment.

Does it need a paid API key?

No. Models run locally from Hugging Face checkpoints; you need your own GPU, not any hosted API.

How does OpenVLA compare with openpi?

Both are open VLA projects: OpenVLA centers on a single 7B autoregressive model with public training code and LoRA/OFT recipes, while openpi focuses on Physical Intelligence's pi-series flow-matching models.

How do I get started?

Install the minimal requirements, load openvla/openvla-7b with transformers, and run the README's inference example with a sample image and instruction.

// continue explorando

Ferramentas semelhantes

Agentes de IA

openpi

Physical Intelligence's open vision-language-action models (pi0, pi0-FAST, pi0.5) for robot policies.

★ 14,1 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

tada

An open-source speech language model from Hume.

★ 1,0 mil estrelasNOASSERTION
Ver o guia →
Agentes de IA

Isaac-GR00T

NVIDIA Isaac GR00T N1.7 — an open foundation model for generalist robots, ready to fine-tune and deploy.

★ 8,2 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

Qwen-AgentWorld

Qwen-AgentWorld: a language world model simulating MCP, terminal, web, and OS environments for agents.

★ 1,0 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

Jev Ultrafast

Jev Ultrafast — the fastest browser agent from browser-use: one decision-model request per action cycle drives a real browser, MIT

★ 23,7 mil estrelasMIT
Ver o guia →
Agentes de IA

LaVague

A Large Action Model framework for building AI web agents that browse and act for you.

★ 6,4 mil estrelasApache-2.0
Ver o guia →
// alternativas

Alternativas em Agentes de IA

Os outros projetos de Agentes de IA com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se openvla não for o ideal para você.

// mais em agents

Mais em Agentes de IA

Projetos de Agentes de IA próximos no catálogo, os mais próximos em estrelas de openvla: continue explorando dos dois lados dele.

Baixe o openvla

Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.