SGLang is a high-performance serving framework for large language models and multimodal models.
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
SGLang is a high-performance serving framework for large language models and multimodal models.
AI Observability & Evaluation
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
A full-stack RAG engineering guide: how to build retrieval-augmented LLM applications end to end, with a free online edition.
SOTA Open Source TTS
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
A high-throughput and memory-efficient inference and serving engine for LLMs
LlamaIndex is the document processing platform for AI
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.