SimWorld
SimWorld: an Unreal Engine 5 simulator for evaluating LLM/VLM agents in physical and social worlds.
A framework for evaluating and improving AI agents.
harbor is an open-source ai agents project by harbor-framework (harbor-framework/harbor on GitHub). It has 5,906 GitHub stars and 1,948 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 8 October 2026.
Decide what you want the project to do before installing anything.
Grab the source and skim the README for setup requirements.
Install dependencies and add any API keys or settings it needs.
Launch it and follow the example workflow from the docs.
Structured evaluation harnesses.
Interactive worlds for agents.
Ties to terminal-based benchmarks.
Evaluate, then iterate.
Fits research and eng workflows.
Open and commercially friendly.
Download the source and move into the project folder.
git clone https://github.com/harbor-framework/harbor.git
cd harborCreate a virtual environment and install the requirements.
python -m venv .venv && source .venv/bin/activate
pip install -r requirements.txtTreat these as starting points - the README documents the exact commands.
python examples/quickstart.pyIt is an open-source project at harbor-framework/harbor with 1948 forks. Check the repo's contributors and recent commits to judge how active maintenance is.
Yes - it is Apache-2.0 licensed, so it is free for commercial use with attribution.
Running the evaluation is free; the model under test may use your own paid API keys.
Harbor is a full eval-and-improve framework; ClawBench is a specific browser-agent benchmark; autoevals is a lightweight scoring library. Use Harbor for the eval program, the others for specific measurements.
Clone the repo, read the README's quickstart, and run the provided example - most projects get you to a first result in minutes.
SimWorld: an Unreal Engine 5 simulator for evaluating LLM/VLM agents in physical and social worlds.
Modular Python framework for AI agents and workflows with tools and memory.
Apache framework for apps that make decisions: agents, chatbots, simulations.
AI-plus-IoT framework bringing AI agents to ESP32 and Tuya chips.
AI-native visual analytics framework that helps agents chart your data.
The agent that grows with you — a Python framework for adaptive AI agents.
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if harbor is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.