Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar: Inference & Training

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
4 open-source projects
sglang sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

attentionblackwell
39k Python Apache-2.0Updated 2d ago
openvino openvinotoolkit/openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

aicomputer-vision
11.2k C++ Apache-2.0Updated 2d ago
peft huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapterdiffusion
21.9k Python Apache-2.0Updated 2d ago
U
unsloth unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

fine-tuningllm
79.7k Python Apache-2.0