sglang
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
attentionblackwell
39k
Python
Apache-2.0Updated 2d ago
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
SGLang is a high-performance serving framework for large language models and multimodal models.
VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
The open-source AI voice studio. Clone, dictate, create.
A high-throughput and memory-efficient inference and serving engine for LLMs