Rust Apache-2.0

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Stars
1,693
Forks
99
Open issues
30
Last commit

Share this project

Link

Share to

Star growth

We record this repository's stars once a day. The chart appears after a few days of data.

More in Web Servers, Proxies & Databases

  1. A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.

    • Rust
    • #ai
    • #api
    • #app-search

    59.9k stars

    Last commit

  2. A scalable, distributed, collaborative, document-graph database, for the realtime web

    • Rust
    • #backend-as-a-service
    • #cloud-database
    • #database

    33.3k stars

    Last commit

  3. Scalable datastore for metrics, events, and real-time analytics

    • Rust
    • Apache-2.0
    • #database
    • #go
    • #influxdb

    31.8k stars

    Last commit

  4. 25 MB lightweight cross-platform database client for 100+ databases, including MySQL, PostgreSQL, SQLite, Redis, MongoDB, DuckDB, SQL Server, and Dameng. Built-in AI, MCP Server, CLI, desktop and Docker. | 轻量级跨平台数...

    • Rust
    • Apache-2.0
    • #ai
    • #cli
    • #clickhouse

    30.5k stars

    Last commit

  5. Search infrastructure for AI

    • Rust
    • Apache-2.0
    • #agents
    • #ai
    • #ai-agents

    29.7k stars

    Last commit

  6. Development at the speed of light

    • Rust
    • #database
    • #dataoriented
    • #game-development

    25.6k stars

    Last commit