☰
Home
Portals
›
Education
Ask the Atlas
About
›
Report a bug
Request a feature
The AI Atlas
Beta
Dark
Admin login
Dark
☰
Loading…
Tooling Monitor
i
AI Tooling Monitor
Catalog
Table
Last scan Oct 19, 2026 · 72 found · 2 cataloged · next scan Monday 07:00 UTC
Category
All
Coding assistants and agents
Agent platforms and orchestration
Enterprise search and knowledge assistants
Document intelligence and extraction
Model gateways and LLMOps
Evaluation and observability
Guardrails, security, and governance
Contact center and customer service AI
Workflow automation and back office
Data, labeling, and synthetic data
Voice agents
Meeting and productivity copilots
Analytics and data copilots
Financial services vertical AI
Legal and compliance AI
Sales and marketing AI
Deployment
Any
SaaS
VPC
On-prem
API
Open source
Desktop
Maturity
Any
Early stage startup
Growth stage startup
Scaleup
Incumbent
Big tech
Open source project
Maturity unknown
Pricing
Any
Free
Freemium
Per seat
Usage based
Enterprise
Clear all ×
8 of 54 products match
Evaluation and observability
· 8
AgentOps
AgentOps
An open-source observability framework for AI agents that tracks usage, costs, and performance metrics.
Early stage startup · SaaS · On-prem · Freemium · first seen Oct 5, 2026
agent tracing
time travel debugging
session replay
token tracking
cost tracking
Arize AI
Arize AI
An AI observability and evaluation platform for monitoring and improving machine learning models.
Open source project · SaaS · Open source · API · first seen Oct 5, 2026
agent tracing
online evaluations
span and session evals
prompt testing
root cause analysis
Arize Phoenix
Arize AI
An open-source observability toolkit from Arize for debugging and analyzing LLM applications.
Open source project · Open source · SaaS · On-prem · Freemium · first seen Oct 5, 2026
agent tracing
llm evaluation
llm-as-judge annotations
human review labeling
experiment benchmarking
Braintrust
Braintrust
An end-to-end platform for evaluating and improving LLM applications with a focus on data quality and model performance.
Growth stage startup · SaaS · VPC · first seen Oct 5, 2026
agent trace observability
llm and human evals
production log search
pattern discovery
failure diagnosis
Fiddler AI
Fiddler Labs
An AI observability and governance platform for monitoring model performance, drift, and fairness in production.
Growth stage startup · SaaS · VPC · On-prem · Freemium · first seen Oct 5, 2026
agent monitoring and observability
continuous evaluations
inline guardrails under 80ms
pii and phi redaction
jailbreak and prompt injection blocking
Future AGI
Future AGI
An open-source, self-hostable end-to-end platform for evaluating, observing, simulating, and improving LLM and AI agent applications.
Open source project · SaaS · API · Open source · VPC · Freemium · first seen Sep 18, 2026
agent simulations
synthetic data generation
datasets
agent ide
experiments
Langfuse
Langfuse
An open-source LLM engineering platform providing tracing, prompt management, and evaluation capabilities.
Open source project · SaaS · VPC · On-prem · Open source · Freemium · first seen Sep 18, 2026
llm tracing
llm-as-a-judge evals
human annotation
prompt management
playground model comparison
Opik
Comet ML
An open-source tool for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows with tracing and dashboards.
Open source project · SaaS · Open source · On-prem · Freemium · first seen Sep 18, 2026
trace logging
llm-as-a-judge evaluation
heuristic metrics
hallucination detection
prompt optimization
New this week · 2
This week's new-entrants report →
Microsoft Fabric
An end-to-end analytics platform that integrates data engineering, data science, real-time analytics, and business intelligence with AI-powered features like Copilot and data agents.
Big tech · first seen Oct 19, 2026
Movo
A self-hosted enterprise Agent platform that harnesses DeepSeek models for knowledge retrieval, deep research, content generation, and browser automation with governance controls.
Open source project · first seen Oct 19, 2026