Opik

Evaluation and observability · Comet ML · Open source project

An open-source tool for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows with tracing and dashboards. comet.com ↗

Facts

DescriptionOpik is an open-source end-to-end AI engineering platform for understanding, measuring, and improving LLM applications. It logs traces of LLM calls and agent steps, supports test suites and LLM-as-a-judge evaluation, monitors production quality, cost, and latency, and offers automated prompt optimization. It runs on the Comet platform and is available as cloud, open source, and enterprise editions with self-hosting.

DeploymentSaaSOpen sourceOn-prem

PricingFreemium

Pricing detailCloud, open source, and enterprise versions all include full feature set; no prices stated.

Target buyersengineeringdata

IntegrationsOpenAIAnthropicLangChainClaude CodeCursorVS Code CopilotCodexOpencodeOllamaDockerKubernetes

Compliance claimsSSO

Models usedOpenAIAnthropic

Features · 15

trace loggingllm-as-a-judge evaluationheuristic metricshallucination detectionprompt optimizationprompt versioningprompt playgroundtest suites from tracesproduction monitoringcost trackingguardrailsalertsmcp serverannotation queuesself-hosting

Dossier · model-written summary

Opik is Comet ML's open-source (Apache 2.0) LLM observability and evaluation platform, launched in September 2024, targeting teams building LLM apps, RAG pipelines, and agentic workflows. Its genuine full-stack open-source license and low cloud entry price are real differentiators versus proprietary rivals like LangSmith, but the platform is still relatively young and carries the credibility risk of a vendor whose core revenue historically came from classical MLOps experiment tracking rather than GenAI observability. The enterprise tier's compliance posture and identity/governance features (SSO, RBAC) are flagged by critics as friction points that surface only at scale, and enterprise pricing is opaque. Competitors such as Langfuse received a $400M Series D-level acquisition by ClickHouse in early 2026, signaling this market is consolidating fast and Comet's position is not yet locked in.

Sources: 16

Timeline · 5 events

2026-08-01FeatureOpik product page positions platform as a top AI observability choice for 2026, adding MCP server and Diagnostics agent features ↗deepdive

2026-05-01NewsOpik reaches 20,000+ GitHub stars, among the fastest-growing LLM observability projects ↗deepdive

2026-01-01NewsLangfuse acquired by ClickHouse in a $400M Series D, validating the ClickHouse-based LLM observability architecture Opik also uses ↗deepdive

2025-12-01NewsOpik no-code Optimization Studio added to the platform ↗deepdive

2024-09-17LaunchComet launches Opik, an open-source LLM evaluation platform ↗

Same category · Evaluation and observability

AgentOps Fiddler AI Braintrust Arize Phoenix Langfuse Arize AI Future AGI