Tensors and Dynamic neural networks in Python with strong GPU acceleration
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
Tensors and Dynamic neural networks in Python with strong GPU acceleration
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Ongoing research training transformer models at scale
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
SGLang is a high-performance serving framework for large language models and multimodal models.
AI Observability & Evaluation
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Go ahead and axolotl questions
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
An Open Source Machine Learning Framework for Everyone
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
AirLLM 2.8T LLM inference with single 4GB GPU
Label Studio is a multi-type data labeling and annotation tool with standardized output format
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
Deep Learning for humans
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Distribute and run LLMs with a single file.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)