Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built a...
1.7k stars
Last commit
Updated daily 1,594 open-source projects · GitHub data from Nov 16, 2026
The software layer under a website: web servers, reverse proxies, caches and databases.
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built a...
1.7k stars
Last commit
Repository names, descriptions and star counts come from the GitHub API. HowVPS is not affiliated with GitHub or with the projects listed.