sglang
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
attentionblackwell
39k
Python
Apache-2.0Updated 2d ago
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
SGLang is a high-performance serving framework for large language models and multimodal models.
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
AirLLM 2.8T LLM inference with single 4GB GPU
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.