The Future Of AI Is Hybrid
datanami, Monday, February 12th, 2024
Artificial intelligence today is largely something that occurs in the cloud, where huge AI models are trained and deployed on massive racks of GPUs. But as AI makes its inevitable migration into to the applications and devices that people use every day, it will need to run on smaller compute devices deployed to the edge and connected to the cloud in a hybrid manner.
That's the prediction of Luis Ceze, the University of Washington computer science professor and Octo AI CEO, who has closely watched the AI space evolve over the past few years. According to Ceze, AI workloads will need to break out of the cloud and run locally if it's going to have the impact foreseen by many.
In a recent interview with Datanami, Ceze gave several reasons for this shift. For starters, the Great GPU Squeeze is forcing AI practitioners to search for compute wherever they can find it. find new making the edge look downright hospitable today, he.