Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
About this project
opik is an open-source inference and training project on GitHub: Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. It is infrastructure rather than a finished product: the layer that serves, quantises, trains or orchestrates models. It is maintained by comet-ml and published as a public repository you can read, fork and run yourself.
On GitHub the repository is tagged evaluation, langchain, llama-index, llm, llm-evaluation, llm-observability, llmops, open-source, openai and playground, which is a fair summary of what it covers. That generally means an API surface, batching and memory management, and often an OpenAI-compatible endpoint so existing clients keep working unchanged.
It is written mainly in Java and released under APACHE-2.0, a permissive license — commercial use is fine as long as copyright notices are kept. It is actively maintained: the most recent commit landed on November 18, 2026.
To try it, clone the repository and follow its README; that file is the canonical install guide. There is also a project page at https://www.comet.com/docs/opik/ for documentation or a hosted demo. Because it runs on your own infrastructure, budget time for environment setup: dependencies, model weights and configuration usually take longer than the first successful run.
Key facts as recorded on GitHub: 23,448 stars; 1,964 forks; primary language Java; license APACHE-2.0; last commit on November 18, 2026; topics evaluation, langchain, llama-index, llm, llm-evaluation, llm-observability.