// agents · vibrantlabsai/ragas

ragas

ragas é um projeto de agentes de IA de código aberto de vibrantlabsai (vibrantlabsai/ragas no GitHub). Tem 15.966 estrelas no GitHub e 1.750 forks, é publicado sob a licença Apache-2.0 e foi atualizado pela última vez no GitHub em 24 de fevereiro de 2026.

Supercharge LLM app evaluations with objective metrics, synthetic test data and feedback loops.

★ 16,0 mil estrelas⑂ 1,8 mil forksApache-2.0atualizado fev 2026
▦ visual: o README deste projeto não inclui nenhuma captura incorporável,
então aqui vai um marcador. O guia abaixo está completo mesmo assim.
// dados do projeto

Dados do projeto

Estrelas no GitHub
15.966
Forks
1.750
Licença
Apache-2.0
Última atualização no GitHub
24 de fevereiro de 2026
Categoria
Agentes de IA
Tipo de ficha
Guia de instalação completo
Site oficial
Official site
// como funciona

Como funciona

  1. Clarify what quality means for your app

    Choose the aspects you need to measure, such as answer accuracy, faithfulness to retrieved context, or relevance for your RAG pipeline.

  2. Install ragas

    Add the library to your Python project from PyPI, or install it directly from the GitHub source.

  3. Create or generate a test set

    Bring examples from your application, or let ragas generate a production-aligned test dataset covering a range of scenarios.

  4. Score outputs and iterate

    Run pre-built or custom metrics over your app's outputs, read the scores and reasons, and use them to tune prompts, retrieval and models.

// recursos

Por que as pessoas gostam tanto

Objective evaluation metrics

Evaluate LLM applications with both LLM-based and traditional metrics instead of subjective manual review.

Test data generation

Automatically create comprehensive test datasets, including production-aligned test set generation when you have no dataset ready.

Custom aspect metrics

Define your own evaluators, such as an Aspect Critique built with DiscreteMetric, to score any aspect of an output with a reason.

Quickstart project templates

The ragas quickstart command scaffolds a complete evaluation project, starting with a rag_eval template for RAG systems.

Framework integrations

Works with popular LLM frameworks like LangChain and major observability tools, so scores fit into existing pipelines.

Feedback loops from production

Leverage production data to continually improve your LLM applications rather than evaluating once and stopping.

Advertisement
// execute você mesmo

Execute você mesmo

  1. Clone the repository

    Clone the ragas source if you want to develop against it; most users install from PyPI instead.

    git clone https://github.com/vibrantlabsai/ragas.git
    cd ragas
  2. Install from PyPI

    Install the released package into your Python environment.

    pip install ragas
  3. Scaffold an evaluation project

    Use the quickstart command to create a ready-made RAG evaluation project, then add your data and run it.

    ragas quickstart rag_eval
// casos de uso

O que você pode criar

Advertisement
// perguntas frequentes

Perguntas frequentes

Who maintains ragas?

Ragas is developed by vibrantlabsai (the team behind Ragas) together with open-source contributors.

Is ragas free to use?

Yes. The library is Apache-2.0 licensed and free, including for commercial use.

Does it need a paid API key?

Often, yes: many ragas metrics use an LLM as the judge, and the quickstart examples expect a provider key such as OPENAI_API_KEY. You pay your provider for those calls; traditional metrics do not need one.

How does ragas compare with LangSmith or manual review?

Ragas focuses on open-source, code-first metrics and test-set generation you run in your own pipeline, while hosted platforms bundle evaluation with tracing and dashboards; many teams use ragas metrics inside their existing observability stack.

How do I get started?

Run pip install ragas, then ragas quickstart rag_eval to scaffold a project, set your model provider key, and score your first outputs.

// continue explorando

Ferramentas semelhantes

Agentes de IA

Data-Analysis-Agent

Chat with your data: an LLM agent that builds charts and business insights.

★ 2,6 mil estrelasCustom
Ver o guia →
Agentes de IA

promptfoo

Test prompts, agents and RAGs — LLM evals, red teaming and model comparisons from the CLI

★ 25,8 mil estrelasMIT
Ver o guia →
Agentes de IA

goose

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

★ 54,9 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

RD-Agent

Microsoft's R&D-Agent: LLM agents that automate data-driven research, Kaggle modelling and LLM fine-tuning.

★ 14,9 mil estrelasMIT
Ver o guia →
Agentes de IA

label-studio

The open-source studio for labeling data of every type.

★ 28,4 mil estrelasApache-2.0
Ver o guia →
Agentes de IA

Guardrails

Programmable guardrails to keep LLM systems safe and on rails.

★ 7,3 mil estrelasNOASSERTION
Ver o guia →
// alternativas

Alternativas em Agentes de IA

Os outros projetos de Agentes de IA com mais estrelas no catálogo do LibreAI — a lista realista de alternativas se ragas não for o ideal para você.

// mais em agents

Mais em Agentes de IA

Projetos de Agentes de IA próximos no catálogo, os mais próximos em estrelas de ragas: continue explorando dos dois lados dele.

Baixe o ragas

Grátis e aberto: pegue o código-fonte, dê uma estrela no repositório e comece a criar.