LibreAI / Agentes de IA / promptfoo
// agents · promptfoo/promptfoo

promptfoo

promptfoo é um projeto de agentes de IA de código aberto de promptfoo (promptfoo/promptfoo no GitHub). Tem 25.815 estrelas no GitHub e 2.452 forks, é publicado sob a licença MIT e foi atualizado pela última vez no GitHub em 8 de outubro de 2026.

Test prompts, agents and RAGs — LLM evals, red teaming and model comparisons from the CLI

★ 25,8 mil estrelas⑂ 2,5 mil forksMITatualizado out 2026
▦ visual: o README deste projeto não inclui nenhuma captura incorporável,
então aqui vai um marcador. O guia abaixo está completo mesmo assim.
// dados do projeto

Dados do projeto

Estrelas no GitHub
25.815
Forks
2.452
Licença
MIT
Última atualização no GitHub
8 de outubro de 2026
Categoria
Agentes de IA
Tipo de ficha
Guia de instalação completo
Site oficial
Official site
// como funciona

Como funciona

  1. Clarify your goal

    Decide what you want to achieve with promptfoo and check the README on GitHub for requirements before installing.

  2. Get the code

    Clone the repository from GitHub (or take the packaged install route in step 3 if the README offers one).

  3. Install and configure

    Follow the project's documented install commands — the Run section below lists the exact ones — and add any required API keys or models.

  4. Run your first task

    Work through the README's quickstart example end to end, then adapt it to your own project or data.

// recursos

Por que as pessoas gostam tanto

Prompt and model comparison

Run the same test set across models and prompts to compare quality side by side.

Red teaming and vulnerability scanning

Automated probes for prompt injection, jailbreaks and other AI security issues.

RAG and agent evaluation

Evaluate retrieval pipelines and agent behaviors, not just single prompts.

Declarative configs

Tests live in simple config files that version well in git.

CI/CD integration

Designed to run in pipelines so regressions block deploys.

Local-first CLI

Runs from your terminal with npx — no platform account required to start.

Advertisement
// execute você mesmo

Execute você mesmo

  1. Clone the repository

    Get the Promptfoo source and examples.

    git clone https://github.com/promptfoo/promptfoo.git
    cd promptfoo
  2. Install the CLI

    Install globally from npm (brew and pip installs are also documented), or skip installation with npx.

    npm install -g promptfoo
  3. Run your first eval

    Initialize an example config, add your model key, and run the evaluation.

    promptfoo init
    promptfoo eval
// casos de uso

O que você pode criar

Advertisement
// perguntas frequentes

Perguntas frequentes

Who maintains promptfoo?

promptfoo is maintained by the promptfoo organization/account on GitHub, together with open-source contributors, in the public repository promptfoo/promptfoo.

Is promptfoo free to use?

Yes — the code is open source under the MIT license. You can use, modify and redistribute it under that license's terms.

Does promptfoo need a paid API key?

Promptfoo is free and MIT-licensed; evaluations call the models you test, so you need API keys for those providers (local/open models are also supported).

How does promptfoo compare to LangSmith / Braintrust?

Those are hosted evaluation platforms; Promptfoo is a local-first, config-in-git CLI with strong red-teaming — lighter to adopt, and your tests live with your code.

How do I get started with promptfoo?

Clone the repository from GitHub, follow the install commands in the Run section (taken from the project's README), and complete the documented quickstart example before adapting it to your own use case.

// continue explorando

Ferramentas semelhantes

Agentes de IA

bisheng

Enterprise LLM app platform: GenAI workflows, RAG, agents, model management, evaluation, fine-tuning.

★ 12,0 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

pi

A TypeScript toolkit for building agents: unified LLM API, loop, TUI, and CLI.

★ 113,3 mil estrelasMIT
Ver o guia →
Agentes de IA

botpress

Open-source hub of integrations, SDK and CLI for building and deploying GPT/LLM chatbots and agents.

★ 14,9 mil estrelasMIT
Ver o guia →
Agentes de IA

deepteam

Open-source red-teaming framework that stress-tests LLMs and AI agents.

★ 3,0 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

MobileBuildMCP

An MCP server and CLI that lets AI agents build, test and run iOS and macOS projects.

★ 6,5 mil estrelasMIT
Ver o guia →
Agentes de IA

agentdojo

Test your agents against prompt-injection attacks.

★ 897 estrelasMIT
Ver o guia →
// alternativas

Alternativas em Agentes de IA

Os outros projetos de Agentes de IA com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se promptfoo não for o ideal para você.

// mais em agents

Mais em Agentes de IA

Projetos de Agentes de IA próximos no catálogo, os mais próximos em estrelas de promptfoo: continue explorando dos dois lados dele.

Baixe o promptfoo

Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.