agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI β¦
Open-source observability for AI agents: trace, evaluate, guard, and improve.
openlit is an open-source agents project by openlit (openlit/openlit on GitHub). It has 2,814 GitHub stars and 418 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 1 October 2026.
Add OpenLIT tracing to your agent code.
See every model call, tool use, and decision.
Score agent behavior against your standards.
Add guardrails and iterate on weak spots.
Standard observability under the hood.
Score quality, not just latency.
Catch bad behavior before users see it.
Improve everything around the model.
Scales to serious trace volumes.
Works with Claude Code, Codex, and more.
Download the source and move into the project folder.
git clone https://github.com/openlit/openlit.git
cd openlitEvery project documents its own setup; start with install requirements.
cat README.md | head -60Follow the projectβs launch command β Docker, pip, npm, or a binary release.
# see README for the exact launch commandIt is an open-source project at openlit/openlit with 418 forks.
Yes. Apache-2.0 licensed.
It is OTEL-native and frames itself around harness engineering.
Yes. It is designed to run on your own stack.
Claude Code, Codex, and others; check the docs for integrations.
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI β¦
The fullstack MCP framework to develop MCP Apps for ChatGPT / Claude & MCP Servers for AI Agents.
Build resilient agents
Open-source LLM observability: trace, evaluate and monitor apps and agents
Observability and evaluation for AI apps β see what your agents do.
Open-source LLM observability: monitor, evaluate, and experiment.
The most-starred other Agents projects in the LibreAI catalogue β the realistic shortlist if openlit is not the right fit.
A personal AI that really does things β on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you β a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open β grab the source, star the repo, and start creating.