Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar: Inference & Training

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
8 open-source projects
ray ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

data-sciencedeep-learning
44.3k Python Apache-2.0Updated 2d ago
DeepSpeed deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

billion-parameterscompression
43.3k Python Apache-2.0Updated 2d ago
keras keras-team/keras

Deep Learning for humans

data-sciencedeep-learning
64.4k Python Apache-2.0Updated 2d ago
peft huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapterdiffusion
21.9k Python Apache-2.0Updated 2d ago
litgpt Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

aiartificial-intelligence
13.8k Python Apache-2.0Updated 9d ago
L
litellm BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

ai-gatewayanthropic
63.4k Python MIT
L
LlamaFactory hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuninginstruction-tuning
76.1k Python Apache-2.0
V
vllm vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

cudainference
97.1k Python Apache-2.0