While this will speed up loads of things, it also feels like this will end up being another way to remove upgradability from devices. Want more ram in your desktop buy a new cpu.
The article says the whole CPU has like 200MB of memory, so it's not really replacing the RAM already in PCs. Plus this seems focused on AI applications, not general computing.
And that's fair, at the same time it's still quite new, once it's matured a bit I could definitely see this being how things go until...idk, hardlight computing or w.e
So... they'll probably add some slower, larger-capacity memory chips on the side, and then they'll need to copy data back and forth between the slow off-chip memory and the fast on-chip memory... I'm pretty sure they've just invented cache