Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Curated on GitHub

Open Source Radar

Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.

148Projects
8.8mTotal stars
10Categories
7 open-source projects
Megatron-LM NVIDIA/Megatron-LM

Ongoing research training transformer models at scale

large-language-modelsmodel-para
18.4k Python Updated 2d ago
peft huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapterdiffusion
21.9k Python Apache-2.0Updated 2d ago
train-llm-from-scratch FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

geminilarge-language-models
13.3k Python MITUpdated 4d ago
vit-pytorch lucidrains/vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

artificial-intelligenceattention-mechanism
25.6k Python MITUpdated 12d ago
annotated_deep_learning_paper_implementations labmlai/annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

attentiondeep-learning
67.8k Python MITUpdated 18d ago
L
LlamaFactory hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuninginstruction-tuning
76.1k Python Apache-2.0
T
transformers huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

audiodeep-learning
169.2k Python Apache-2.0