100 TOPS, Zero Production: Why Edge AI Projects Die Between Demo and Deployment – We Talk IoT #83

Edge AI promised intelligence everywhere. The reality? Most projects die between proof of concept and production. In this episode, Amir Sherman from DeepX and Michaël Uyttersprot from Avnet Silica reveal why moving AI from comfortable development kits to demanding industrial environments isn't just difficult. It's a maze of incompatible metrics, hidden power costs, and integration nightmares that catch companies off guard.

We discuss why TOPS ratings mislead engineers, how ChatGPT triggered a wave of failed internal deployments, and what it takes to run vision AI in factories, delivery robots, and smart cities where five-watt power budgets matter more than marketing specifications.

From Hyundai's factory robots to Baidu's Chinese character recognition systems, Amir and Michaël share real deployments that work, and explain the 50 years of embedded experience that AI code generators cannot replace. If you've wondered why edge AI keeps hitting walls nobody discusses in vendor presentations, this conversation delivers the answers.

#EdgeAI #DeepX #IndustrialIoT #VisionAI #NPU #WeTalkIoT

 

Summary of this week's episode:

01:45 Guest Introductions: Amir Sherman and Michaël Uyttersprot

03:29 The Edge AI Market Landscape: TinyML to High-End NPUs

06:47 Why Edge AI Projects Fail in Production

09:18 The TOPS Trap: Why Performance Metrics Mislead

11:50 Choosing Hardware: Why It's More Complex Than It Looks

16:28 Real Deployments: Delivery Robots and Chinese OCR

19:29 Vision AI in European Factories and AGVs

21:32 Generative AI at the Edge: 20 Billion Parameters in Five Watts

23:52 Smart Cities: Traffic Lights and Vision Language Models

27:22 What Engineers Need to Understand About Edge AI

30:48 Why 50 Years of Experience Still Matters

33:13 Bohemian Rhapsody and AI-Generated Llama Songs

 

Show notes:

Amir Sherman: https://www.linkedin.com/in/sherman-bizdev/

Michaël Uyttersprot: https://www.linkedin.com/in/micha%C3%ABl-uyttersprot-aaa971211/

 

DeepX: https://deepx.ai/

DeepX at Avnet Silica: https://my.avnet.com/silica/manufacturers/m/deepx/

 

Listen to the "We Talk IoT" Soundtrack on:

Spotify: https://open.spotify.com/playlist/05MOV4OV2MH2in2txsAGtG?si=ad08112cb8d443f4

YouTube: https://www.youtube.com/watch?v=D-NvQ6VJYtE&list=PLLqgVFfZhDRVYmpEqbgajzDvGL4kACRDp

 

About Avnet Silica:

This podcast is brought to you by Avnet Silica—the Engineers of Evolution. Subscribe to our newsletters here: https://my.avnet.com/silica/resources/newsletter/

You can connect with us on LinkedIn: https://www.linkedin.com/company/silica-an-avnet-company/

Or find us at www.avnet-silica.com