AI Agents
tada
An open-source speech language model from Hume.
★ 1.0k starsNOASSERTION
View guide →Fast, best-practice evaluations for AI model outputs.
autoevals is an open-source ai agents project by braintrustdata (braintrustdata/autoevals on GitHub). It has 1,050 GitHub stars and 88 forks, is released under the MIT license, and was last updated on GitHub on 7 October 2026.
Write down the task or workflow you want the agent to handle.
Clone the repository and read the README's prerequisites.
Install dependencies and configure keys or endpoints.
Run the sample script and check the output against the docs.
Common eval patterns out of the box.
Braintrust's eval expertise packaged.
A library, not a platform.
Use models to score models.
Drops into test suites.
Free for any use.
Download the source and move into the project folder.
git clone https://github.com/braintrustdata/autoevals.git
cd autoevalsCreate a virtual environment and install the requirements.
python -m venv .venv && source .venv/bin/activate
pip install -r requirements.txtTreat these as starting points - the README documents the exact commands.
python examples/quickstart.pyThe project lives at braintrustdata/autoevals and has attracted 88 forks. Browse its commit history and contributor list for a sense of maintenance pace.
Yes - it is MIT licensed, so you can use, modify, and distribute it freely, including in commercial projects.
Running the evaluation is free; the model under test may use your own paid API keys.
AutoEvals is a lightweight scoring library; Harbor is a full evaluation framework. Start with AutoEvals for quick scoring, graduate to Harbor for a complete eval program.
The README and the official docs site are the fastest path: run the quickstart example first, then adapt it to your use case.
An open-source speech language model from Hume.
Open-source 7B vision-language-action model and codebase for generalist robot manipulation.
Up to 20x faster AI coding with smart model routing and full self-hosting.
Snowflake's Agent World Model: synthesise 1,000 executable MCP tool-use environments for agentic RL.
Simple, fast retrieval-augmented generation with graph smarts.
A Python simulation platform for robotics and embodied AI — fast physics, rendering and learning
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if autoevals is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.