Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.
- C++
- Self-Hosted Apps
- MIT
- #anthropic-api
- #cuda
- #deepseek
3k stars
Last commit