Mehmet Murat Ezbiderli
- 1 episode on Chain of Thought
- 5 topics covered
- 1 full transcript
- Dec 2024 first on the show
At the time of the conversation, Mehmet Murat Ezbiderli was building AI at ServiceTitan. He joined the enterprise AI deployment panel on Chain of Thought to share firsthand lessons on cost, model selection, and the trade-offs of shipping GenAI systems at scale.
What this guest adds
Mehmet Murat Ezbiderli says model selection at ServiceTitan has to account for LLM costs alongside stronger capabilities. Read transcript at 35:00
Episodes
-
EP 6 · Open Source AI
The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio
What the conversations cover
These notes summarize the episodes featuring Mehmet Murat Ezbiderli, including other speakers in panel conversations. Follow a source link to read the discussion in context.
EP 6 The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio
- Mehmet (ServiceTitan): “Second Chance Leads” reassesses conversations a CSR marked as a non-lead — if the system decides the call should have booked a job, it triggers a callback within about five minutes. Mehmet calls it a direct ROI generator because it recovers a lead that was already missed. Episode takeaways
- Mehmet (ServiceTitan): for an actual virtual assistant, the LLM cost was “about at least half” of the operational overhead (hedged — “I don’t know the exact numbers” — and inclusive of all compute). On model-to-task fit, GPT-3.5 works great for summarization or sentiment detection, while GPT-4.0 is reserved for reasoning-heavy work like virtual assistants. Episode takeaways
- Mehmet (ServiceTitan): large context “defeats RAG in pretty much all” contextual Q&A, but you pay for it on every request. Emerging self-route / staggered approaches first ask the LLM whether it can answer from the RAG window, and only fall back to large context when it says it cannot. Episode takeaways
In their words
Even if that's not the end of the story, you need to do your due diligence of staggered deployments, you know, like real time monitoring, all that stuff still persists.
Mehmet Murat Ezbiderli The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio · 35:00 Transcript excerpts; ellipses mark omitted words. Some automatically selected quotes have filler words removed.
Explained on AI, decoded
- How do you cut the cost of running an AI agent?
- How do AI voice agents work?
- Can switching to an open model actually cut your AI costs?
- How do you measure whether AI is actually paying off?
- How do you test an AI system when the output isn't deterministic?
- Why do most enterprise AI projects fail to show ROI?