Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar: Inference & Training

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
4 open-source projects
sglang sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

attentionblackwell
39k Python Apache-2.0Updated 2d ago
promptfoo promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

cici-cd
27.4k TypeScript MITUpdated 2d ago
airllm lyogavin/airllm

AirLLM 2.8T LLM inference with single 4GB GPU

chinese-llmchinese-nlp
42.6k Jupyter Notebook Apache-2.0Updated 2d ago
litgpt Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

aiartificial-intelligence
13.8k Python Apache-2.0Updated 9d ago