Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
SGLang is a high-performance serving framework for large language models and multimodal models.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Machine Learning Engineering Open Book
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
SANA & Sol: Efficient Generative Models and Full-Stack Training & Inference Engines for Image, Video, and World Modeling
Faster Whisper transcription with CTranslate2
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
Official inference repo for FLUX.1 models
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
A high-throughput and memory-efficient inference and serving engine for LLMs
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.