LibreAI / AI Agents / harbor
// agents · harbor-framework/harbor

harbor

A framework for evaluating and improving AI agents.

★ 5.9k stars⑂ 1.9k forksApache-2.0updated 2026-10
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

harbor is an open-source ai agents project by harbor-framework (harbor-framework/harbor on GitHub). It has 5,906 GitHub stars and 1,948 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 8 October 2026.

GitHub stars
5,906
Forks
1,948
License
Apache-2.0
Last updated on GitHub
8 October 2026
Category
AI Agents
Listing
Full install guide
Official site
Official site
// how it works

How it works

  1. Clarify your goal

    Decide what you want the project to do before installing anything.

  2. Clone the repo

    Grab the source and skim the README for setup requirements.

  3. Install and configure

    Install dependencies and add any API keys or settings it needs.

  4. Run your first task

    Launch it and follow the example workflow from the docs.

// features

Why people love it

Agent evals

Structured evaluation harnesses.

RL environments

Interactive worlds for agents.

Terminal-bench lineage

Ties to terminal-based benchmarks.

Improvement loops

Evaluate, then iterate.

Python-native

Fits research and eng workflows.

Apache-2.0

Open and commercially friendly.

Advertisement
// run it

Run it yourself

  1. Step 1 - Clone the repo

    Download the source and move into the project folder.

    git clone https://github.com/harbor-framework/harbor.git
    cd harbor
  2. Step 2 - Install dependencies

    Create a virtual environment and install the requirements.

    python -m venv .venv && source .venv/bin/activate
    pip install -r requirements.txt
  3. Step 3 - Run an example

    Treat these as starting points - the README documents the exact commands.

    python examples/quickstart.py
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who maintains harbor?

It is an open-source project at harbor-framework/harbor with 1948 forks. Check the repo's contributors and recent commits to judge how active maintenance is.

Is harbor free to use?

Yes - it is Apache-2.0 licensed, so it is free for commercial use with attribution.

Do I need a paid API to use it?

Running the evaluation is free; the model under test may use your own paid API keys.

Harbor vs ClawBench vs autoevals?

Harbor is a full eval-and-improve framework; ClawBench is a specific browser-agent benchmark; autoevals is a lightweight scoring library. Use Harbor for the eval program, the others for specific measurements.

How do I get started?

Clone the repo, read the README's quickstart, and run the provided example - most projects get you to a first result in minutes.

// keep exploring

Similar tools

AI Agents

SimWorld

SimWorld: an Unreal Engine 5 simulator for evaluating LLM/VLM agents in physical and social worlds.

★ 793 starsApache-2.0
View guide →
Agents

griptape

Modular Python framework for AI agents and workflows with tools and memory.

★ 2.6k starsApache-2.0
View guide →
Agents

burr

Apache framework for apps that make decisions: agents, chatbots, simulations.

★ 2.6k starsApache-2.0
View guide →
Agents

TuyaOpen

AI-plus-IoT framework bringing AI agents to ESP32 and Tuya chips.

★ 1.9k starsCustom
View guide →
Agents

AVA

AI-native visual analytics framework that helps agents chart your data.

★ 1.6k starsMIT
View guide →
AI Agents

hermes-agent

The agent that grows with you — a Python framework for adaptive AI agents.

★ 252.0k starsMIT
View guide →
// alternatives

Alternatives in AI Agents

The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if harbor is not the right fit.

Get harbor

Free and open — grab the source, star the repo, and start creating.