// agents · vibrantlabsai/ragas

ragas

ragas es un proyecto de agentes de IA de código abierto de vibrantlabsai (vibrantlabsai/ragas en GitHub). Tiene 15.966 estrellas en GitHub y 1.750 bifurcaciones, se publica bajo la licencia Apache-2.0 y se actualizó por última vez en GitHub el 24 de febrero de 2026.

Supercharge LLM app evaluations with objective metrics, synthetic test data and feedback loops.

★ 16,0k estrellas⑂ 1,8k bifurcacionesApache-2.0actualizado feb 2026
▦ visual: el README de este proyecto no incluye ninguna captura incrustable,
así que aquí va un marcador. La guía de abajo está completa de todos modos.
// datos del proyecto

Datos del proyecto

Estrellas en GitHub
15.966
Bifurcaciones
1.750
Licencia
Apache-2.0
Última actualización en GitHub
24 de febrero de 2026
Categoría
Agentes de IA
Tipo de ficha
Guía de instalación completa
Sitio oficial
Official site
// cómo funciona

Cómo funciona

  1. Clarify what quality means for your app

    Choose the aspects you need to measure, such as answer accuracy, faithfulness to retrieved context, or relevance for your RAG pipeline.

  2. Install ragas

    Add the library to your Python project from PyPI, or install it directly from the GitHub source.

  3. Create or generate a test set

    Bring examples from your application, or let ragas generate a production-aligned test dataset covering a range of scenarios.

  4. Score outputs and iterate

    Run pre-built or custom metrics over your app's outputs, read the scores and reasons, and use them to tune prompts, retrieval and models.

// características

Por qué gusta tanto

Objective evaluation metrics

Evaluate LLM applications with both LLM-based and traditional metrics instead of subjective manual review.

Test data generation

Automatically create comprehensive test datasets, including production-aligned test set generation when you have no dataset ready.

Custom aspect metrics

Define your own evaluators, such as an Aspect Critique built with DiscreteMetric, to score any aspect of an output with a reason.

Quickstart project templates

The ragas quickstart command scaffolds a complete evaluation project, starting with a rag_eval template for RAG systems.

Framework integrations

Works with popular LLM frameworks like LangChain and major observability tools, so scores fit into existing pipelines.

Feedback loops from production

Leverage production data to continually improve your LLM applications rather than evaluating once and stopping.

Advertisement
// ejecútalo

Ejecútalo tú mismo

  1. Clone the repository

    Clone the ragas source if you want to develop against it; most users install from PyPI instead.

    git clone https://github.com/vibrantlabsai/ragas.git
    cd ragas
  2. Install from PyPI

    Install the released package into your Python environment.

    pip install ragas
  3. Scaffold an evaluation project

    Use the quickstart command to create a ready-made RAG evaluation project, then add your data and run it.

    ragas quickstart rag_eval
// casos de uso

Qué puedes crear

Advertisement
// preguntas frecuentes

Preguntas frecuentes

Who maintains ragas?

Ragas is developed by vibrantlabsai (the team behind Ragas) together with open-source contributors.

Is ragas free to use?

Yes. The library is Apache-2.0 licensed and free, including for commercial use.

Does it need a paid API key?

Often, yes: many ragas metrics use an LLM as the judge, and the quickstart examples expect a provider key such as OPENAI_API_KEY. You pay your provider for those calls; traditional metrics do not need one.

How does ragas compare with LangSmith or manual review?

Ragas focuses on open-source, code-first metrics and test-set generation you run in your own pipeline, while hosted platforms bundle evaluation with tracing and dashboards; many teams use ragas metrics inside their existing observability stack.

How do I get started?

Run pip install ragas, then ragas quickstart rag_eval to scaffold a project, set your model provider key, and score your first outputs.

// sigue explorando

Herramientas similares

Agentes de IA

Data-Analysis-Agent

Chat with your data: an LLM agent that builds charts and business insights.

★ 2,6k estrellasCustom
Ver la guía →
Agentes de IA

promptfoo

Test prompts, agents and RAGs — LLM evals, red teaming and model comparisons from the CLI

★ 25,8k estrellasMIT
Ver la guía →
Agentes de IA

goose

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

★ 54,9k estrellasApache-2.0
Ver la guía →
Agentes de IA

RD-Agent

Microsoft's R&D-Agent: LLM agents that automate data-driven research, Kaggle modelling and LLM fine-tuning.

★ 14,9k estrellasMIT
Ver la guía →
Agentes de IA

label-studio

The open-source studio for labeling data of every type.

★ 28,4k estrellasApache-2.0
Ver la guía →
Agentes de IA

Guardrails

Programmable guardrails to keep LLM systems safe and on rails.

★ 7,3k estrellasNOASSERTION
Ver la guía →
// alternativas

Alternativas en Agentes de IA

Los demás proyectos de Agentes de IA con más estrellas del catálogo de LibreAI: la lista realista de alternativas si ragas no es lo que buscas.

// más en agents

Más en Agentes de IA

Proyectos de Agentes de IA cercanos en el catálogo, los más próximos en estrellas a ragas: sigue explorando a ambos lados.

Consigue ragas

Gratis y abierto: consigue el código fuente, dale una estrella al repositorio y empieza a crear.