Tensors and Dynamic neural networks in Python with strong GPU acceleration
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
Tensors and Dynamic neural networks in Python with strong GPU acceleration
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
AirLLM 2.8T LLM inference with single 4GB GPU
State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
Machine Learning Engineering Open Book
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.