LibreAI / RAG & Knowledge / cocoindex
// rag · cocoindex-io/cocoindex

cocoindex

Incremental engine that keeps RAG indexes and agent context fresh by processing only the delta.

★ 11.7k stars⑂ 910 forksApache-2.0updated 2026-10
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

cocoindex is an open-source rag & knowledge project by cocoindex-io (cocoindex-io/cocoindex on GitHub). It has 11,653 GitHub stars and 910 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 7 October 2026.

GitHub stars
11,653
Forks
910
License
Apache-2.0
Last updated on GitHub
7 October 2026
Listing
Full install guide
Official site
Official site
// how it works

How it works

  1. Identify the context your agent needs

    Pick a source (a docs folder, a codebase, Slack, meeting transcripts) and the target it should feed, such as a pgvector table for RAG.

  2. Install CocoIndex

    Add the Python package to your project with pip.

  3. Declare the pipeline

    Write a small Python flow: walk the source, split and embed content, and declare rows and a vector index in the target - the quickstart example is about twenty lines.

  4. Run it, then re-run freely

    Run the app once to backfill; run it again any time (or continuously) and only changed files re-embed, keeping the index fresh at a fraction of the cost.

// features

Why people love it

Delta-only incremental processing

Only the change - in source data or in your transformation code - is reprocessed; unchanged content hits the cache, so freshness costs a fraction of full recomputation.

Declarative Python flows

You declare the desired target state in plain Python functions rather than hand-managing DAGs, state and invalidation.

End-to-end lineage

Every vector, row or graph node traces back to its exact source byte, making pipelines debuggable and auditable.

Many sources and targets

Connectors span codebases, file systems and blob stores, databases, message queues, images, video and transcripts; targets include vector, graph and relational stores, warehouses, queues and feature stores.

Production-grade Rust core

The core engine is Rust, with retries, exponential back-off, dead-letter queues and failure isolation so one bad record does not stall the flow.

Ready-made examples

20+ working starters: real-time code indexing with AST chunking, PDF-to-RAG, conversation-to-knowledge-graph, structured extraction, podcast transcription graphs and CSV-to-Kafka streaming.

Advertisement
// run it

Run it yourself

  1. Clone the repository

    Clone CocoIndex for the examples tree; most users install the package from PyPI instead.

    git clone https://github.com/cocoindex-io/cocoindex.git
    cd cocoindex
  2. Install the package

    Install CocoIndex into your Python environment.

    pip install -U cocoindex
  3. Run your first flow

    Define an App that walks a docs folder, chunks and embeds it into Postgres, then run its update - re-runs only process the delta.

    python main.py  # your flow file - see the README quickstart for the exact code
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who maintains CocoIndex?

CocoIndex is developed by cocoindex-io and open-source contributors, with an additional Enterprise offering for very large corpora.

Is CocoIndex free?

Yes. The open-source engine is Apache-2.0 licensed.

Does it need a paid API key?

Only for the models you choose in your transformations: local embedding models need no key, while hosted LLM or embedding APIs use your own credentials.

How does CocoIndex compare with Airbyte, Dagster or a cron embedding script?

Those move or schedule batch jobs; CocoIndex is a stateful incremental engine that tracks per-record provenance and recomputes only the delta when sources or code change.

How do I get started?

Run pip install -U cocoindex and copy the quickstart flow: declare a source, a splitter, an embedding target, and run the app.

// keep exploring

Similar tools

RAG & Knowledge

ragflow

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context…

★ 91.6k starsApache-2.0
View guide →
RAG & Knowledge

PageIndex

PageIndex: vectorless, reasoning-based RAG that indexes documents like a human expert would

★ 39.0k starsMIT
View guide →
RAG & Knowledge

codealive-mcp

Codealive-mcp, in Python — built for context engine for large codebases, exposed throug...

★ 90 starsMIT
View guide →
RAG & Knowledge

uteke

Self-hosted rag & knowledge: 🧠 the brain for your ai — local-first memory engine for.

★ 268 starsApache-2.0
View guide →
RAG & Knowledge

Langchain-Chatchat

Local knowledge-base RAG and agent app built on LangChain with ChatGLM, Qwen and Llama models

★ 38.7k starsApache-2.0
View guide →
RAG & Knowledge

WeKnora

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

★ 31.9k starsUnknown
View guide →
// alternatives

Alternatives in RAG & Knowledge

The most-starred other RAG & Knowledge projects in the LibreAI catalogue — the realistic shortlist if cocoindex is not the right fit.

Get cocoindex

Free and open — grab the source, star the repo, and start creating.