Rust Apache-2.0
intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
- Stars
- 1,693
- Forks
- 99
- Open issues
- 30
- Last commit
Star growth
We record this repository's stars once a day. The chart appears after a few days of data.
More in Web Servers, Proxies & Databases
-
A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.
- Rust
- #ai
- #api
- #app-search
59.9k stars
Last commit
-
A scalable, distributed, collaborative, document-graph database, for the realtime web
- Rust
- #backend-as-a-service
- #cloud-database
- #database
33.3k stars
Last commit
-
Scalable datastore for metrics, events, and real-time analytics
- Rust
- Apache-2.0
- #database
- #go
- #influxdb
31.8k stars
Last commit
-
25 MB lightweight cross-platform database client for 100+ databases, including MySQL, PostgreSQL, SQLite, Redis, MongoDB, DuckDB, SQL Server, and Dameng. Built-in AI, MCP Server, CLI, desktop and Docker. | 轻量级跨平台数...
- Rust
- Apache-2.0
- #ai
- #cli
- #clickhouse
30.5k stars
Last commit
-
29.7k stars
Last commit
-
Development at the speed of light
- Rust
- #database
- #dataoriented
- #game-development
25.6k stars
Last commit
Project README
Loaded live from GitHub in your browser. It belongs to the project and is shown unedited. Read it on GitHub
Loading the README…
Community discussions
Hacker News stories that link to this repository, loaded live from the public HN search API.
Loading discussions…
Rankings
Position among the 1,594 projects tracked here, from the latest GitHub data.
- #167 Most starred in Web Servers, Proxies & Databases of 190
- #90 Most starred Rust projects of 117
- #1,222 Most starred overall of 1,594