開発ツール
Scrapling
Adaptive web scraping framework in Python — from a single request to a full-scale crawl
★ 86.3k スターBSD-3-Clause
ガイドを見る →Scrapegraph-aiは、ScrapeGraphAIが公開しているオープンソースの開発ツールプロジェクトです（GitHub: ScrapeGraphAI/Scrapegraph-ai）。GitHubスターは31,623、フォークは3,221で、MITライセンスの下で公開されています。GitHubでの最終更新は2026年10月6日です。
Scrape any website with a prompt: LLM-powered scraping pipelines in a few lines of Python
Decide what you want to achieve with Scrapegraph-ai and check the README on GitHub for requirements before installing.
Clone the repository from GitHub (or take the packaged install route in step 3 if the README offers one).
Follow the project's documented install commands — the Run section below lists the exact ones — and add any required API keys or models.
Work through the README's quickstart example end to end, then adapt it to your own project or data.
Describe the data you want in plain language; the LLM builds the extraction for you.
The flagship graph scrapes a page and returns structured output from a single prompt and URL.
Additional pipelines cover searching, multi-page scraping and other extraction patterns documented in the docs.
Works with different LLM providers and models through a simple config object.
Extracted, structured content drops neatly into RAG and data pipelines.
A hosted ScrapeGraph API and SDKs exist if you outgrow local runs (the open-source library remains MIT).
Get the library source and examples.
git clone https://github.com/ScrapeGraphAI/Scrapegraph-ai.git
cd Scrapegraph-aiInstall ScrapeGraphAI from PyPI.
pip install scrapegraphaiCreate a SmartScraperGraph with your model config, a prompt and a URL, then call run() as in the README usage example.
# graph = SmartScraperGraph(prompt='Extract the product names and prices', source='https://example.com', config=graph_config)
# result = graph.run() # see README Usage for the full snippetScrapegraph-ai is maintained by the ScrapeGraphAI organization/account on GitHub, together with open-source contributors, in the public repository ScrapeGraphAI/Scrapegraph-ai.
Yes — the code is open source under the MIT license. You can use, modify and redistribute it under that license's terms.
The library is free, but extraction is LLM-driven — you need your own LLM API key (or a local model), and you pay that provider's token costs.
Classic scrapers are free per run but break when layouts change; ScrapeGraphAI trades a small LLM cost per page for prompts that survive redesigns.
Clone the repository from GitHub, follow the install commands in the Run section (taken from the project's README), and complete the documented quickstart example before adapting it to your own use case.
Adaptive web scraping framework in Python — from a single request to a full-scale crawl
Expose your FastAPI endpoints as Model Context Protocol tools - with authentication - in a few lines of code.
Generates agent-first Go CLIs (plus MCP servers) for any API or website — with local SQLite sync built in
Turn any website into a CLI — and let AI agents drive your already-logged-in browser
⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openag…
A bridge between Streamable HTTP / SSE and stdio MCP transports — connect any client to any server
LibreAIカタログに掲載された開発ツールプロジェクトの中で最もスターの多いもの — Scrapegraph-aiが合わなかった場合に検討したい、現実的な候補リストです。
The open source coding agent
The model-definition framework behind modern AI — thousands of pretrained transformers for text, vision, and audio.
Anthropic's agentic coding tool that lives in your terminal and works across your whole codebase
Cross-platform desktop all-in-one manager for Claude Code, Codex, OpenCode and other coding agents
OpenAI's lightweight coding agent that runs locally in your terminal
カタログの中でScrapegraph-aiとスター数が近い開発ツールプロジェクト — 前後の棚もそのまま見て回れます。
Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked con…
An MCP toolkit that gives coding agents IDE-grade semantic retrieval, editing and refactoring
Hugging Face's free course on AI agents — smolagents, LangGraph and LlamaIndex, with a final benchmark
Turn any website into a CLI — and let AI agents drive your already-logged-in browser
Self-hosted AI coding assistant
Pack your whole repository into one AI-friendly file for Claude, ChatGPT, Gemini and more