The Question Every AI Team Forgets to Ask About Their Own Agent (with Moritz Sudhof)

Every company that ships an AI agent wants to know if it is actually working. Dashboards report session counts and completion rates, but they cannot show if a user left satisfied or walked away frustrated. Moritz Sudhof built Bigspin AI to close that gap, reading every conversation between a company's users and its AI agent and delivering a daily report on what broke down and why. One Bigspin customer rolled out the same AI product, the same model, and the same prompts to two different companies. It thrived at the first. It went quiet at the second. The real difference was buried in the transcripts the whole time. In this episode of Lead with AI, Dr. Tamara Nall speaks with Moritz Sudhof about building Bigspin AI after leading AI coaching products at BetterUp, why the biggest lever for improving an AI system often sits outside the AI itself, and how research with Stanford professor Chris Potts uncovered failure patterns standard monitoring misses. Moritz explains why two identical AI products performed in totally different ways depending on how each was introduced to its users, why people should treat AI as a collaborator rather than a vending machine, and where he expects agent-to-agent conversation to head by 2030. Want to see how Bigspin AI works? Visit bigspin.ai to learn more or request early access. Check out the links below to follow Moritz, connect with the Bigspin AI team, and subscribe to Lead with AI for more conversations with the leaders building the future. Follow or Subscribe to Lead with AI Podcast Website: https://www.leadwithaipodcast.com Apple Podcasts: https://podcasts.apple.com/us/podcast/lead-with-ai/id1802979004 Spotify: https://open.spotify.com/show/01BFepfiNGP9pOrqWpmkud YouTube: https://www.youtube.com/@leadwithaipodcast Facebook: https://www.facebook.com/profile.php?id=61572557201507 Instagram: https://www.instagram.com/leadwithaipodcast TikTok: https://www.tiktok.com/@leadwithaipodcast Twitter (X): https://www.x.com/leadwithai Follow Dr. Tamara Nall LinkedIn: https://www.linkedin.com/in/tamaranall Website: https://www.tamaranall.com Email: Tamara@LeadwithAIPodcast.com Follow Moritz Sudhof (Co-founder & CEO, Bigspin AI) LinkedIn: https://www.linkedin.com/in/sudhof/ Website: https://bigspin.ai/ LinkedIn (Bigspin AI): https://www.linkedin.com/company/bigspin-ai/