openvino
openvinotoolkit/openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
aicomputer-vision
11.2k
C++
Apache-2.0Updated 2d ago
Scanning GitHub for open-source AI projects that are actually worth running: self-hostable, forkable, with a clear license. Star counts and languages are verified against each repository.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
AirLLM 2.8T LLM inference with single 4GB GPU
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!