Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar: Inference & Training

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
9 open-source projects
langfuse langfuse/langfuse

🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

ai-gatewayanalytics
37.6k TypeScript Updated 2d ago
sglang sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

attentionblackwell
39k Python Apache-2.0Updated 2d ago
phoenix Arize-ai/phoenix

AI Observability & Evaluation

agentsai-monitoring
12.3k Python Updated 2d ago
opik comet-ml/opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

evaluationlangchain
23.4k Java Apache-2.0Updated 2d ago
airllm lyogavin/airllm

AirLLM 2.8T LLM inference with single 4GB GPU

chinese-llmchinese-nlp
42.6k Jupyter Notebook Apache-2.0Updated 2d ago
OpenLLM bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentomlfine-tuning
12.6k Python Apache-2.0Updated 3d ago
llamafile mozilla-ai/llamafile

Distribute and run LLMs with a single file.

cross-platformgguf
26.7k C++ Updated 11d ago
L
LlamaFactory hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuninginstruction-tuning
76.1k Python Apache-2.0
V
vllm vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

cudainference
97.1k Python Apache-2.0