Lessons from Deploying AI at Enterprise Scale | ServiceTitan, Indeed & Twilio

Chain of Thought

This week, a panel of experts (Mehmet Murat Ezbiderli, ServiceTitan; Grant Ledford, Indeed; and Vinnie Giarrusso, Twilio) join Atin Sanyal (CTO, Galileo) and Conor Bronsdon (Developer Awareness, Galileo) to explore the challenges and opportunities of deploying GenAI at enterprise scale in a conversation that's a wake-up call for any business leader looking to harness the power of AI.

Together, Atin & Conor break down key considerations like performance, cost, and model selection, emphasizing the need for robust evaluation frameworks and a shift in developer mindset.

Atin then sits down with our panel of AI engineering experts to discuss their firsthand experiences with enterprise AI, including the trade-offs of building AI systems, the evolving tools and frameworks available, and the impact these technologies are having on their organizations.

Chapters: 00:00 Enterprise Scale Deployment

05:17 Cost, Performance, and Model Selection

08:59 Building and Integrating GenAI Systems

15:26 Emerging Enterprise Use Cases

18:12 Predictions for AI in 2025

27:28 Panel Discussion: Deploying AI at Enterprise Scale

31:19 Gen AI Solutions and Challenges

33:12 Building & Deploying Traditional Infrastructure vs GenAI Infrastructure

34:36 How to Assemble Your GenAI Stack

40:39 Today's Best GenAI Use Cases

48:15 Enterprise AI Trends for 2025

50:36 Closing Remarks and Future Outlook

Follow:

Atin Sanyal: ⁠⁠⁠https://www.linkedin.com/in/atinsanyal/⁠

Mehmet Murat Ezbiderli: https://www.linkedin.com/in/mehmet-murat-ezbiderli-b894a49/ Grant Ledford: https://www.linkedin.com/in/grant-ledford-36b146a5/ Vinnie Giarrusso: https://www.linkedin.com/in/vinniegiarrusso/

Show notes: Watch all of Productionize: https://www.galileo.ai/genai-productionize-2-0