Skip to content

Grant Ledford

Indeed

  • 1 episode on Chain of Thought
  • 5 topics covered
  • 1 full transcript
  • Dec 2024 first on the show
Grant Ledford

At the time of the conversation, Grant Ledford was working on AI at Indeed. He joined the enterprise AI deployment panel on Chain of Thought to talk through real-world experiences building and running GenAI systems in production.

Cover art for The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio

Latest episode with Grant Ledford · EP 6

The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio

Mehmet Murat Ezbiderli, Vinnie Giarrusso, Grant Ledford & Atindriyo Sanyal ·

Show notes & transcript → All listening options →

Episodes

What the conversations cover

These notes summarize the episodes featuring Grant Ledford, including other speakers in panel conversations. Follow a source link to read the discussion in context.

EP 6 The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio

  • Mehmet (ServiceTitan): “Second Chance Leads” reassesses conversations a CSR marked as a non-lead — if the system decides the call should have booked a job, it triggers a callback within about five minutes. Mehmet calls it a direct ROI generator because it recovers a lead that was already missed. Episode takeaways
  • Mehmet (ServiceTitan): for an actual virtual assistant, the LLM cost was “about at least half” of the operational overhead (hedged — “I don’t know the exact numbers” — and inclusive of all compute). On model-to-task fit, GPT-3.5 works great for summarization or sentiment detection, while GPT-4.0 is reserved for reasoning-heavy work like virtual assistants. Episode takeaways
  • Mehmet (ServiceTitan): large context “defeats RAG in pretty much all” contextual Q&A, but you pay for it on every request. Emerging self-route / staggered approaches first ask the LLM whether it can answer from the RAG window, and only fall back to large context when it says it cannot. Episode takeaways

In their words

Yeah, I think there's two, I'd say one is compound systems and that has an infrastructure as a whole so you can actually build out more complex use cases and have confidence that those work well. And the other is that, as we saw in like the keynote, there's a ton of players in the kind of tooling and infrastructural space for building all on based applications and as the winners and subcategories get identified, it'll be easier to get all those pieces to play well together. So I think that's something that will happen more over the next year as well, is there'll be some clear front runners that get better tie in and an option.

Grant Ledford The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio · 50:00

Transcript excerpts; ellipses mark omitted words. Some automatically selected quotes have filler words removed.