deepteam
Open-source red-teaming framework that stress-tests LLMs and AI agents.
deepevalは、confident-aiが公開しているオープンソースのAIエージェントプロジェクトです(GitHub: confident-ai/deepeval)。GitHubスターは18,695、フォークは2,032で、Apache-2.0ライセンスの下で公開されています。GitHubでの最終更新は2026年10月7日です。
Unit tests for LLMs — evaluate before you ship.
Pick one concrete task so you can judge whether the project fits.
Clone the repo and check the prerequisites listed in the README.
Install what it needs and configure credentials or model access.
Run a minimal example end to end before wiring it into your stack.
A library of evaluation metrics for model outputs.
Integrates with pytest-style workflows.
Catch quality drops between model versions.
Maintained by confident-ai with docs and cloud options.
Apache-2.0 licensed.
Designed to run in automated pipelines.
Install DeepEval from PyPI.
pip install deepevalDefine metrics over your model's outputs in a test file.
# see README for metric examples
# test_example.pyExecute the evaluation suite.
deepeval test run test_example.pyIt is maintained by confident-ai at confident-ai/deepeval, with 2,032 forks.
The open-source framework is free under Apache-2.0; a cloud tier also exists.
Core evals run locally; some metrics may call models through your own API keys.
Compare with Ragas, LangSmith evals, and others on metrics coverage and workflow fit.
Install the package, write a test file with your metrics, and run it.
Open-source red-teaming framework that stress-tests LLMs and AI agents.
Put guardrails on LLMs: validate outputs before they reach users.
Open-source LLM observability: monitor, evaluate, and experiment.
A rigorous benchmark for LLMs acting as agents.
Chinese-language course on AI basics: GPU architecture, CUDA, LLMs, and agents.
JADX plugin + MCP server that lets LLMs analyze Android APKs live — decompile, review, find vulnerabilities
LibreAIカタログに掲載されたAIエージェントプロジェクトの中で最もスターの多いもの — deepevalが合わなかった場合に検討したい、現実的な候補リストです。
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
カタログの中でdeepevalとスター数が近いAIエージェントプロジェクト — 前後の棚もそのまま見て回れます。
Agent Zero AI framework
Microsoft's trainer for AI agents - reinforcement learning for almost any agent framework
Open source agentic operating system
A self-healing harness that connects an LLM directly to your real browser
Devika - the open-source agentic software engineer that plans, browses and writes code
Build customer-facing AI agents that actually follow your rules