Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar: Inference & Training

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
6 open-source projects
mlflow mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

agentopsagents
28.9k Python Apache-2.0Updated 2d ago
ray ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

data-sciencedeep-learning
44.3k Python Apache-2.0Updated 2d ago
axolotl axolotl-ai-cloud/axolotl

Go ahead and axolotl questions

fine-tuningllm
12.7k Python Apache-2.0Updated 2d ago
BentoML bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

ai-inferencedeep-learning
8.9k Python Apache-2.0Updated 3d ago
OpenLLM bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentomlfine-tuning
12.6k Python Apache-2.0Updated 3d ago
U
unsloth unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

fine-tuningllm
79.7k Python Apache-2.0