Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar: Inference & Training

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
3 open-source projects
openvino openvinotoolkit/openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

aicomputer-vision
11.2k C++ Apache-2.0Updated 2d ago
airllm lyogavin/airllm

AirLLM 2.8T LLM inference with single 4GB GPU

chinese-llmchinese-nlp
42.6k Jupyter Notebook Apache-2.0Updated 2d ago
BentoML bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

ai-inferencedeep-learning
8.9k Python Apache-2.0Updated 3d ago