AI Agents
opik
Open-source LLM observability: trace, evaluate and monitor apps and agents
★ 22.5k starsApache-2.0
View guide →Open-source LLM observability: monitor, evaluate, and experiment.
helicone is an open-source ai agents project by Helicone (Helicone/helicone on GitHub). It has 6,207 GitHub stars and 683 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 16 September 2026.
Start with one concrete task rather than a grand architecture.
Clone the repo and check the examples folder for a quickstart.
Install packages, set environment variables, and point it at your model.
Execute the demo workflow, then adapt it to your own data.
Proxy your calls with minimal code.
Every prompt and completion recorded.
Score outputs and track quality.
A/B prompts and models.
See what your agents spend.
Self-hostable and open.
Download the source and move into the project folder.
git clone https://github.com/Helicone/helicone.git
cd heliconePull in the Node packages the project needs.
npm installTreat these as starting points - the README documents the exact commands.
npm run buildHelicone/helicone is its home on GitHub, with 683 forks so far. The contributors tab and recent commits show how actively it is maintained.
Yes - it is Apache-2.0 licensed, so it is free for commercial use with attribution.
Self-hosting is free and open source; the hosted cloud version may have a paid tier.
Both observe LLM apps. Helicone is a proxy-based observability platform; Weave is a dev toolkit from the Weights & Biases team. Try Helicone for drop-in monitoring, Weave for deeper experiment tracking.
Follow the README quickstart, then browse the examples directory for patterns that match what you want to build.
Open-source LLM observability: trace, evaluate and monitor apps and agents
OpenTelemetry-native observability for LLM apps.
Open-source observability for AI agents: trace, evaluate, guard, and improve.
One open platform to simulate, evaluate, guardrail, trace, and optimise LLM and agent apps, self-hostable.
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic syst…
Code, build and evaluate LLM agents with full MCP, Skills, ACP and A2A support.
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if helicone is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.