Breaking the Compute Bottleneck: Power, Memory, and the New AI Architecture Paradigms

One problem is that current AI systems devote all their resources to even the simplest questions, noted Rabin Sugumar, co-founder and CEO of Akeana. “A lot of solutions tend to be brute force,” he said. “If you ask ChatGPT, ‘Where do I go for coffee?’ All 600 billion parameters are fetched, and the whole compute goes through.”