LibreAI / Agents IA / openvla
// agents · openvla/openvla

openvla

openvla est un projet de agents IA open source, créé par openvla (openvla/openvla sur GitHub). Il compte 7 123 étoiles sur GitHub et 854 forks, il est publié sous la licence MIT et a été mis à jour pour la dernière fois sur GitHub le 23 mars 2025.

Open-source 7B vision-language-action model and codebase for generalist robot manipulation.

★ 7,1 k étoiles⑂ 854 forksMITmis à jour mars 2025
▦ visuel — le README de ce projet ne contient aucune capture intégrable,
voici donc un emplacement réservé. Le guide ci-dessous est complet malgré tout.
// détails du projet

Détails du projet

Étoiles GitHub
7 123
Forks
854
Licence
MIT
Dernière mise à jour sur GitHub
23 mars 2025
Catégorie
Agents IA
Type de fiche
Guide d'installation complet
// fonctionnement

Comment ça marche

  1. Check your hardware first

    Inference and LoRA fine-tuning need a capable NVIDIA GPU; the README's LoRA example uses a single A100 80GB, and smaller GPUs down to roughly 27GB can work with reduced batch sizes.

  2. Install for inference or training

    For inference, install the minimal requirements and load the checkpoint through Hugging Face transformers; for training, create the conda environment and install the repo editable.

  3. Run zero-shot inference

    Load openvla/openvla-7b with the AutoProcessor, pass a camera image and an instruction prompt, and read out an action with predict_action.

  4. Fine-tune on your robot

    Download a BridgeData V2 or other Open X-Embodiment dataset in RLDS format (or convert your own), then run the LoRA fine-tuning script - or the newer OFT recipe the project now recommends.

// fonctionnalités

Pourquoi on l'adore

Flagship 7B checkpoint

openvla-7b is trained on a mixture of Open X-Embodiment datasets spanning 970K trajectories, with checkpoints, configs and model cards on Hugging Face.

Minimal-dependency inference

A lightweight transformers interface (AutoProcessor and AutoModelForVision2Seq) loads the model with few dependencies, and a REST API serving script is included for robot stacks without on-device compute.

LoRA and full fine-tuning

Built-in examples cover full, partial and (quantized) LoRA fine-tuning via Hugging Face PEFT, plus full fine-tuning with PyTorch FSDP for multi-GPU nodes.

Scales from 1B to 34B

PyTorch FSDP and Flash-Attention power training across model sizes, with native support for arbitrary RLDS dataset mixtures.

FAST action tokenizer support

The project documents the FAST tokenizer, which compresses action chunks into fewer tokens for much faster inference with discrete actions.

OFT fine-tuning recipe

The 2025 OFT update offers an optimized fine-tuning recipe the team recommends for faster inference, higher success rates, multiple input images and high-frequency bimanual control.

Advertisement
// lancez-le

Lancez-le vous-même

  1. Clone the repository

    Clone the OpenVLA codebase for the training, fine-tuning and serving scripts.

    git clone https://github.com/openvla/openvla.git
    cd openvla
  2. Create the environment and install

    Set up the pinned Python 3.10 / PyTorch 2.2 environment from the README, then install the package editable.

    conda create -n openvla python=3.10 -y
    conda activate openvla
    pip install -e .
  3. Load the model for inference

    Install the minimal requirements and load openvla-7b in a few lines of Python.

    pip install -r https://raw.githubusercontent.com/openvla/openvla/main/requirements-min.txt
    python -c "from transformers import AutoProcessor; AutoProcessor.from_pretrained('openvla/openvla-7b', trust_remote_code=True)"  # see README for the full inference example
// cas d'usage

Ce que vous pouvez créer

Advertisement
// faq

Questions fréquentes

Who maintains OpenVLA?

The OpenVLA project team maintains the repository; it is built on the Prismatic VLMs codebase and released alongside the OpenVLA research paper.

Is OpenVLA free to use?

The code is MIT-licensed. The pretrained checkpoints are derived from Llama-2, so their use is governed by the Llama Community License rather than MIT - check its terms before commercial deployment.

Does it need a paid API key?

No. Models run locally from Hugging Face checkpoints; you need your own GPU, not any hosted API.

How does OpenVLA compare with openpi?

Both are open VLA projects: OpenVLA centers on a single 7B autoregressive model with public training code and LoRA/OFT recipes, while openpi focuses on Physical Intelligence's pi-series flow-matching models.

How do I get started?

Install the minimal requirements, load openvla/openvla-7b with transformers, and run the README's inference example with a sample image and instruction.

// continuez l'exploration

Outils similaires

Agents IA

openpi

Physical Intelligence's open vision-language-action models (pi0, pi0-FAST, pi0.5) for robot policies.

★ 14,1 k étoilesApache-2.0
Voir le guide →
Agents IA

tada

An open-source speech language model from Hume.

★ 1,0 k étoilesNOASSERTION
Voir le guide →
Agents IA

Isaac-GR00T

NVIDIA Isaac GR00T N1.7 — an open foundation model for generalist robots, ready to fine-tune and deploy.

★ 8,2 k étoilesApache-2.0
Voir le guide →
Agents IA

Qwen-AgentWorld

Qwen-AgentWorld: a language world model simulating MCP, terminal, web, and OS environments for agents.

★ 1,0 k étoilesApache-2.0
Voir le guide →
Agents IA

Jev Ultrafast

Jev Ultrafast — the fastest browser agent from browser-use: one decision-model request per action cycle drives a real browser, MIT

★ 23,7 k étoilesMIT
Voir le guide →
Agents IA

LaVague

A Large Action Model framework for building AI web agents that browse and act for you.

★ 6,4 k étoilesApache-2.0
Voir le guide →
// alternatives

Alternatives en Agents IA

Les autres projets de la catégorie Agents IA avec le plus d'étoiles du catalogue LibreAI — la sélection réaliste d'alternatives si openvla ne vous convient pas.

// plus en agents

Plus en Agents IA

Projets de la catégorie Agents IA proches dans le catalogue, les plus proches en étoiles de openvla — continuez à explorer de part et d'autre.

Obtenir openvla

Gratuit et ouvert : récupérez le code source, mettez une étoile au dépôt et commencez à créer.