Not Just More Pilots: Shweta Gummidipudi on Scaling AI at Twilio

Most companies can prove an AI use case works. Scaling it is where they stall. Shweta Gummidipudi, CIO at Twilio, has spent her first year building the infrastructure layer that makes scale possible: a single model gateway for routing and cost control, a shared library of agents and connectors, and inference budgets that keep business-unit builds inside enterprise guardrails. She also addresses two problems most governance conversations skip: agentic identity, which the industry has not solved, and agent sprawl, which she maps directly to the shadow IT problem CIOs spent the last decade managing. Alongside those structural challenges, she describes Twilio's Customer Zero program, where IT runs Twilio's own products in live workflows and converts that experience into reference architectures that enterprise customers adopt faster than vendor documentation alone.

Key Highlights:

• Why a single model gateway is the prerequisite for moving from pilots to scale
• How Twilio structured a three-tier access model to prevent agent sprawl without blocking experimentation
• Why agent identity is categorically different from human identity and what that means for security
• How the Customer Zero program turns internal practitioner experience into customer reference architectures
• Why career-leveling guides need to be rebuilt from scratch rather than retitled for the AI era