The AI Inference Economy – What is Edge AI, Exactly?

This article is part of a series exploring two complementary investment themes. The ROBO Global Artificial Intelligence Index (THNQ) captures the digital AI ecosystem, including AI-semiconductors, cloud infrastructure, cybersecurity, connectivity, and applications. The ROBO Global Robotics and Automation Index (ROBO) captures the physical automation ecosystem, including robotics, sensors, semiconductors, and industrial systems. Together, they tell the story of autonomy as intelligence shifts from the cloud to the edge.

At the end of the day, the future robotic and AI-augmented economy will transform every industry. Underneath it all, the drivers are physics, economics, and trust.

What makes edge AI compelling is that demand is broadly distributed. It is not concentrated in a handful of hyperscale buyers. For example, NVIDIA disclosed that two direct customers represented roughly 39 percent of total revenue in their most recent earnings report, with more than half of data center revenue coming from only three customers. Edge demand is more diverse, global, and underappreciated by markets.

Data centers still matter. They power training, simulation, and a growing share of inference. But the next leg of growth will live at the edge.

First principles: What is inference? What is “the edge”?

Inference is AI in use. You ask a model a question. It senses inputs and analyzes them, then acts by returning an output. Robotics uses the same loop: sense, analyze, act.

Today, much of that loop runs in the cloud. As models get faster, cheaper, and smaller, the loop moves closer to where data is created: on your phone, a camera, a robot, a vehicle, or a factory tool. Currently, the majority of inference exists as the query from your fingertips on the Gemini, Claude, Grok, or ChatGPT interface on your phone transmitting to the data center and back with a response. It won’t always be this way.

Edge AI is the physical nexus with the real world. It runs in real time, often on tight power and size budgets.