AI Agents
opik
Open-source LLM observability: trace, evaluate and monitor apps and agents
★ 22.5k starsApache-2.0
View guide →One open platform to simulate, evaluate, guardrail, trace, and optimise LLM and agent apps, self-hostable.
future-agi is an open-source ai agents project by future-agi (future-agi/future-agi on GitHub). It has 2,127 GitHub stars and 671 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 8 October 2026.
Decide whether to self-host (standalone on a laptop or VM, distributed, or Kubernetes) or start with the hosted cloud trial.
Clone the repository and run the installer, which checks your machine, writes local secrets, and downloads the platform images.
Sign in locally, create an account, and copy your API key and secret key from the Keys page.
Instrument your agent with the OpenTelemetry package, send your first trace, then add evaluations, simulations, and guardrails.
OpenTelemetry-native tracing across many agent frameworks, with span graphs, latency, and token-cost dashboards.
Dozens of metrics under one evaluate call, covering areas such as groundedness, hallucination, tool-use correctness, and tone, using LLM-as-judge, heuristic, and ML methods.
Multi-turn conversation simulation against personas, adversarial inputs, and edge cases, for both text and voice agents.
Built-in scanners for issues such as PII and prompt injection, plus adapters for external guardrail vendors, usable inline in the gateway or as an SDK.
An OpenAI-compatible gateway with routing across many providers, semantic caching, and virtual keys.
Several prompt-optimisation algorithms that learn from production traces, closing the loop from monitoring to improvement.
Requires Docker with Compose; the installer prepares secrets and images.
git clone https://github.com/future-agi/future-agi.git
cd future-agi
./bin/installOpen the local app, create your account, and copy the API and secret keys from the Keys page in the sidebar.
# open the installed web app locally and copy FI_API_KEY / FI_SECRET_KEY from KeysInstall the instrumentation package, export your keys, and emit a span from Python.
pip install fi-instrumentation-otel
export FI_API_KEY=<your key>It is maintained by future-agi on GitHub, alongside a commercial cloud offering.
The platform core is Apache-2.0 licensed and free to self-host; the company also offers a managed cloud and enterprise editions.
Not for the platform itself, but evaluations and optimisation call LLMs, so you configure your own provider keys for those features.
Tools such as Langfuse or Phoenix focus mainly on tracing and evals; Future AGI bundles simulation, guardrails, a gateway, and prompt optimisation into the same platform, per its own comparison.
Clone the repo, run ./bin/install, sign in locally, copy your keys, and pip install fi-instrumentation-otel to send a first trace.
Open-source LLM observability: trace, evaluate and monitor apps and agents
A low-code tool for building multi-agent LLM apps — chatbots, RAG and fine-tuning in one flow.
iFLYTEK's enterprise agentic workflow platform — SuperAgents with workflows, RPA and one-click deploy.
Make humans and AI agents work as one team — open-source and self-hostable.
One portable, local-first memory layer for every AI agent - Markdown-native, user-owned and self-evolving.
Code, build and evaluate LLM agents with full MCP, Skills, ACP and A2A support.
The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if future-agi is not the right fit.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Free and open — grab the source, star the repo, and start creating.