opik
Open-source LLM observability: trace, evaluate and monitor apps and agents
openllmetryは、traceloopが公開しているオープンソースのAIエージェントプロジェクトです(GitHub: traceloop/openllmetry)。GitHubスターは7,477、フォークは1,134で、Apache-2.0ライセンスの下で公開されています。GitHubでの最終更新は2026年10月6日です。
OpenTelemetry-native observability for LLM apps.
Choose one real workload to test the project against.
Clone it locally and read through the getting-started guide.
Install the stack it needs and set any environment variables.
Execute the starter example and check results before going further.
Vendor-neutral traces, metrics, and logs.
Captures prompts, completions, and token usage.
Drop-in tracing for Python LLM apps.
Maintained by the Traceloop team.
Permissive licensing.
Built for operating GenAI in production.
Add the instrumentation package to your project.
pip install openllmetryInitialize tracing at your app's startup per the docs.
# see docs for the init snippetSend traces to your OpenTelemetry collector or backend.
# works with Jaeger, Grafana, and other OTel backendsIt is maintained by Traceloop at traceloop/openllmetry, with 1,134 forks.
Yes. It is released under the Apache-2.0 license, which permits commercial use, modification, and redistribution. Read the LICENSE file for the exact terms.
The instrumentation is free; you bring your own tracing backend, self-hosted or otherwise.
It is OpenTelemetry-native and vendor-neutral, so it fits existing observability stacks rather than a dedicated LLM platform.
Install the package, initialize it in your app per the docs, and point it at your collector.
Open-source LLM observability: trace, evaluate and monitor apps and agents
Pydantic Logfire: Python and AI observability on OpenTelemetry — SQL-queryable traces, metrics, and logs
Observability and evaluation for AI apps — see what your agents do.
One open platform to simulate, evaluate, guardrail, trace, and optimise LLM and agent apps, self-hostable.
Open-source LLM observability: monitor, evaluate, and experiment.
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic syst…
LibreAIカタログに掲載されたAIエージェントプロジェクトの中で最もスターの多いもの — openllmetryが合わなかった場合に検討したい、現実的な候補リストです。
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
カタログの中でopenllmetryとスター数が近いAIエージェントプロジェクト — 前後の棚もそのまま見て回れます。
Put guardrails on LLMs: validate outputs before they reach users.
Programmable guardrails to keep LLM systems safe and on rails.
Reef — infrastructure for continually self-improving agents: weight-training and harness-evolving deployments.
Voyager — the open-ended embodied Minecraft agent that writes its own skills and keeps learning for life.
Honcho — Plastic Labs' memory library for stateful agents that learn about their users over time.
The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai