TrueFoundry Enterprise AI Gateway

Model gateways and LLMOps · TrueFoundry · Maturity unknown

An enterprise-grade control plane featuring an LLM, MCP, and Agent Gateway to securely connect, observe, and govern access to models and tools. truefoundry.com ↗

Facts

DescriptionTrueFoundry offers an Enterprise AI Gateway plus MCP and Agent gateways under one control plane, providing unified model routing, fallbacks, rate limits, cost controls, agent identity and access control, guardrails, and full-stack observability. It deploys in VPC, on-prem, air-gapped, hybrid, or public cloud with claims that no data leaves the customer domain. The platform also covers AI deployment, model serving, training and fine-tuning, and prompt management.

DeploymentSaaSVPCOn-premOpen source

PricingEnterprise

Pricing detailDetailed pricing page exists; no figures on homepage. Sandbox free with no credit card.

HQSan Francisco, CA

Target buyersengineeringdataoperationscompliance

IntegrationsOpenTelemetryGrafanaDatadogPrometheusAWSAzureGCP

Compliance claimsSOC 2HIPAAGDPRData residencySSOAudit logs

Models usedClaude

Notable customersNetApp

Features · 15

llm gateway routingmcp gatewayagent gatewayprompt managementagent skills registryadaptive model routingcost controls and quotasrate limiting and fallbacksagent identity and access controlrealtime guardrailsimmutable audit loggingrbac and ssofull-stack tracinggpu cluster optimizationmodel deployment and fine-tuning

Dossier · model-written summary

TrueFoundry's Enterprise AI Gateway is a credible but still-maturing control plane that bundles LLM, MCP, and Agent Gateway capabilities into one governed proxy layer. Its differentiated angle is treating agent-to-tool (MCP) traffic as a first-class citizen alongside model traffic, which most pure-play LLM gateways ignore. The vendor's marketing is aggressive and claims like "30% cost efficiency" and "99% token savings" are self-reported with no independent audit. The customer roster is real but leans toward mid-market and growth-stage companies rather than Fortune 100 names, and independent third-party reviews are thin. For a large enterprise, the key risk is vendor maturity: TrueFoundry remains a funded startup, and enterprises need to pressure-test whether its SLAs, support depth, and compliance certifications hold at scale.

Named customers: NetApp · NVIDIA (GPU cluster optimization via multi-agent LLM system) · Siemens Healthineers · ResMed · Automation Anywhere · Games24x7 · Whatfix · FloQast (accounting transformation platform; AI Gateway case study) · Aviso AI · Wadhwani AI · NeurobitSources: 19

Timeline · 9 events

2026-10-19NewsEnterprise-Grade Was the Subtext — AI Engineer World's Fair 2026 Recap ↗discover

2026-09-01PricingTrueFoundry publishes LiteLLM Enterprise Pricing vs TrueFoundry TCO comparison ↗deepdive

2026-09-01LaunchTrueFoundry GitHub org relaunched with unified AI Gateway (LLM + MCP + Agent) positioning ↗deepdive

2026-04-02NewsTrueFoundry publishes Agent Gateway blog: Unifying the Agentic Stack for multi-agent systems ↗deepdive

2026-01-29News

Same category · Model gateways and LLMOps

Kong AI Gateway Portkey Plano GoModel