Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

Eye On A.I.

Eye On A.I. artwork

Why Enterprise AI Isn't Delivering ROI | Ahmed Bashir, DevRev

Nov 13, 202637 minAudio
ShareXLinkedInFacebookWhatsAppEmail

The pattern is familiar to every enterprise leader: the AI demo works perfectly, the enterprise deployment disappoints, and the CIO can't explain why. Ahmed Bashir, Chief Technology Officer of DevRev, joins Craig Smith with a specific and well-supported answer: the problem isn't the model. It's that enterprise data is organizationally complex, fragmented across dozens of tools, locked behind conditional permissions, organized by custom schemas, and every prominent AI benchmark tests models against flat files with pre-packaged data, which has nothing to do with how enterprise data actually lives. DevRev's Enterprise Bench is the first benchmark to test complete agent harnesses against a realistically distributed enterprise environment where the agent must find, relate, and validate information before performing any task, and the results expose a gap that pre-packaged benchmarks hide entirely. The most striking finding: DevRev's system achieves 50% higher accuracy than Claude Code using the identical Opus family model. The entire delta comes from the shared memory layer, the governance, semantic understanding, and orchestration that sits between the model and the enterprise data. Ahmed's analogy is precise: upgrading a CPU cannot compensate for insufficient RAM, because they perform fundamentally different functions. A more powerful model cannot make up for a weak memory layer for the same reason. The conversation also covers why Enterprise Bench aspires to be for AI agents what TPC benchmarks became for databases in the 1980s - the independent standard that ended vendor benchmark wars and gave buyers a genuinely apples-to-apples comparison - and why the build-vs-buy question in enterprise AI has a quantifiable answer for the first time, visible on a public leaderboard that puts DIY configurations directly alongside proprietary systems. Subscribe to Eye on A.I. for weekly conversations with the people building and deploying the future of AI.

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. Are You Planning 20,000 AI Agents? Capital One Has a Warning | Abhijit Bose

    Nov 20, 202639 minAudio

    Most enterprises are still trying to figure out how to get a handful of AI agents into production. Capital One is running tens of thousands. Abhijit Bose, Senior VP and leader of the company's AI/ML platform engineering...

    Credit the people on this episode

  2. Why AI Goes Rogue: Turing Award Winner Explains Reward Failure | Andrew Barto

    Nov 6, 202644 minAudio

    Andrew Barto on Rewards Gone Rogue Andrew Barto helped found reinforcement learning. He and Richard Sutton wrote the field's standard textbook, and they shared the Turing Award for that work. Reinforcement learning now...

    Credit the people on this episode

  3. AI Agents Will Take 50% of Your Traffic — Is Your Data Ready? | Jeff Lunsford, CEO of Tealium

    Oct 30, 202656 minAudio

    20% of enterprise website traffic is already coming from AI agents rather than humans, and that traffic converts at 38% more revenue per session than human visits. Within a year, Jeff Lunsford expects that number to...

    Credit the people on this episode

  4. How Zip's AI Superagents Automate Procurement End-to-End | Rujul Zaparde

    Oct 23, 202651 minAudio

    Every business in the world has to procure things, and for most of them, that process is slow, manual, and full of money left on the table. Rujul Zaparde, co-founder of Zip, joins Craig to explain how his company is...

    Credit the people on this episode

  5. Is This the Cheapest Way to Use AI in 2026? (65+ Models Tested) | Iskander Malikov, Trioma

    Oct 16, 202655 minAudio

    What if you didn't have to choose between ChatGPT, Claude, and Gemini, and instead, the platform chose for you? That's the core idea behind Trioma, a vertically integrated AI ecosystem built by Iskander and his team in...

    Credit the people on this episode