But could the next big thing be not moving data at all?
Two thirds of power is spent on data movementThe article cites a chart from Rambus that indicates roughly 62.6 percent of power is spent on data movement. A mere 37.4 percent is actually spent on computational tasks. Part of this problem could be solved via computational storage, which embeds processing capabilities directly into storage devices.
If CPU makers go down this path, the processor we know today would basically become the "accelerator of last resort." The idea here would be to move data as little as possible, to boost performance and increase energy efficiency:
Under this model, the CPU would be a bit more like an accelerator itself. Specifically, the CPU becomes the “accelerator” of last resort. When a workload is complex, serialized, or full of branchy, unpredictable code that makes it unsuitable to the GPU and/or whatever future AI hardware AMD and Intel might one day ship, it gets kicked over to the CPU, which specializes in exactly this kind of problem. Move storage searches and some computation into SSDs and RAM, and the CPU has that many more clock cycles to actually crunch data.The downside is that it requires a big rethinking of the storage stack, as well as a restructuring of software. Or in other words, it won't be a quick revolution.