rocketride-server
A high-performance AI pipeline engine - build LLM workflows as portable .pipe files
easy-dataset ist ein Open-Source-Projekt aus der Kategorie Entwickler-Tools von ConardLi (ConardLi/easy-dataset auf GitHub). Es hat 14.981 Sterne auf GitHub und 1.533 Forks, wird unter der Lizenz AGPL-3.0 veröffentlicht und wurde zuletzt am 1. Mai 2026 auf GitHub aktualisiert.
Turn domain documents into high-quality LLM fine-tuning, RAG and evaluation datasets through a visual UI.
Collect the PDFs, Word files, Markdown, EPUB or other documents you want to turn into training or evaluation data.
Start Easy Dataset with Docker Compose or npm, then open it in your browser at http://localhost:1717.
Connect an LLM API (or a local Ollama model), import your files, and let parsing, splitting and the domain label tree run.
Generate questions and answers, check quality scores, then export in Alpaca or ShareGPT format, generate a LLaMA Factory config, or upload to Hugging Face.
Parses PDF, Markdown, DOCX, TXT, EPUB and more, with multiple splitting algorithms (Markdown structure, recursive, fixed length, code-aware) and visual segmentation.
Auto-extracts questions from text segments and generates answers and chain-of-thought with an LLM, guided by a domain label tree built from your documents.
Builds single-turn QA, multi-turn dialogue and image QA datasets, plus data distillation straight from domain topics without uploading documents.
Generates evaluation sets (true/false, choice, short-answer, open-ended), runs judge-model scoring with custom rules, and offers a double-blind human arena.
Exports Alpaca, ShareGPT and other formats as JSON/JSONL, with balanced export per tag, one-click LLaMA Factory config generation and direct Hugging Face upload.
Background batch processing with a task center, token and API-call monitoring dashboards, custom project prompt templates and a 3-model testing playground.
Clone Easy Dataset and enter the project directory.
git clone https://github.com/ConardLi/easy-dataset.git
cd easy-datasetInstall dependencies and build the app (Docker users can skip this and use the official image instead).
npm install
npm run buildLaunch the server and open the UI in your browser.
npm run start
# then open http://localhost:1717It is developed by ConardLi and community contributors; an accompanying paper is on arXiv (2507.04009).
The software is open source under AGPL-3.0, so self-hosting is free; note AGPL conditions apply if you offer it as a network service.
It needs an LLM to generate questions and answers: you can use a paid provider's API key, or a local Ollama model at no API cost.
Easy Dataset replaces ad-hoc parsing/splitting/generation scripts with a visual pipeline, quality scoring and one-click exports to training formats and LLaMA Factory.
Clone the repo (or pull the Docker image), start it, open http://localhost:1717, connect a model, and import your first documents.
A high-performance AI pipeline engine - build LLM workflows as portable .pipe files
Turn papers and code into editable PPTX slides with charts and speaker notes.
A free course to get into large language models, with roadmaps and runnable Colab notebooks
Compress tool outputs, logs and RAG chunks before they reach the LLM — same answers, fewer tokens
Turn your AI assistant into an expert economics-paper writer.
Unified, efficient fine-tuning of 100+ LLMs and VLMs with a CLI and Web UI — ACL 2024
Die anderen Projekte der Kategorie Entwickler-Tools mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls easy-dataset nicht das Richtige ist.
The open source coding agent
The model-definition framework behind modern AI — thousands of pretrained transformers for text, vision, and audio.
Anthropic's agentic coding tool that lives in your terminal and works across your whole codebase
Cross-platform desktop all-in-one manager for Claude Code, Codex, OpenCode and other coding agents
OpenAI's lightweight coding agent that runs locally in your terminal
Verwandte Projekte der Kategorie Entwickler-Tools im Katalog, die easy-dataset bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
Agentic IDE that runs 100+ parallel coding agents in isolated workspaces on your own subscriptions.
Context engineering is the new vibe coding - it's the way to actually make AI coding assistants work. Claude Code is the best for this so that's what this re…
Convert documentation sites, GitHub repos and PDFs into Claude AI skills and RAG-ready knowledge assets.
20+ high-performance LLMs implemented from scratch, with proven recipes to pretrain, finetune and deploy.
Open-source terminal AI coding agent built for large projects and multi-step, real-world tasks.
Xiaomi's terminal-native AI coding assistant where models and agents co-evolve, with project memory.
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.