deepteam
Open-source red-teaming framework that stress-tests LLMs and AI agents.
deepeval é um projeto de agentes de IA de código aberto de confident-ai (confident-ai/deepeval no GitHub). Tem 18.695 estrelas no GitHub e 2.032 forks, é publicado sob a licença Apache-2.0 e foi atualizado pela última vez no GitHub em 7 de outubro de 2026.
Unit tests for LLMs — evaluate before you ship.
Pick one concrete task so you can judge whether the project fits.
Clone the repo and check the prerequisites listed in the README.
Install what it needs and configure credentials or model access.
Run a minimal example end to end before wiring it into your stack.
A library of evaluation metrics for model outputs.
Integrates with pytest-style workflows.
Catch quality drops between model versions.
Maintained by confident-ai with docs and cloud options.
Apache-2.0 licensed.
Designed to run in automated pipelines.
Install DeepEval from PyPI.
pip install deepevalDefine metrics over your model's outputs in a test file.
# see README for metric examples
# test_example.pyExecute the evaluation suite.
deepeval test run test_example.pyIt is maintained by confident-ai at confident-ai/deepeval, with 2,032 forks.
The open-source framework is free under Apache-2.0; a cloud tier also exists.
Core evals run locally; some metrics may call models through your own API keys.
Compare with Ragas, LangSmith evals, and others on metrics coverage and workflow fit.
Install the package, write a test file with your metrics, and run it.
Open-source red-teaming framework that stress-tests LLMs and AI agents.
Put guardrails on LLMs: validate outputs before they reach users.
Open-source LLM observability: monitor, evaluate, and experiment.
A rigorous benchmark for LLMs acting as agents.
Chinese-language course on AI basics: GPU architecture, CUDA, LLMs, and agents.
JADX plugin + MCP server that lets LLMs analyze Android APKs live — decompile, review, find vulnerabilities
Os outros projetos de Agentes de IA com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se deepeval não for o ideal para você.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Projetos de Agentes de IA próximos no catálogo, os mais próximos em estrelas de deepeval: continue explorando dos dois lados dele.
Agent Zero AI framework
Microsoft's trainer for AI agents - reinforcement learning for almost any agent framework
Open source agentic operating system
A self-healing harness that connects an LLM directly to your real browser
Devika - the open-source agentic software engineer that plans, browses and writes code
Build customer-facing AI agents that actually follow your rules
Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.