Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
- TypeScript
- AGPL-3.0
- #ai
- #ai-agents
- #ai-crawler
202.2k stars
Last commit
Updated daily 1,594 open-source projects · GitHub data from Nov 16, 2026
Self-hostable AI software: LLM runtimes, agents, MCP servers and chat interfaces.
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
202.2k stars
Last commit
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scra...
103.5k stars
Last commit
Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can s...
87.4k stars
Last commit
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API,...
21.4k stars
Last commit
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster t...
1.3k stars
Last commit
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
1.2k stars
Last commit
Repository names, descriptions and star counts come from the GitHub API. HowVPS is not affiliated with GitHub or with the projects listed.