This game is called
Passing the 'I/O bottleneck' token from server to network to data array and back again.
How ever did we manage back in the 1980's with all those truly horrible latencies?
Lets face it, you will never get to Zero latency. For many applications a 1 millisecond latency is not a killer. As you head towards the 'God' solution of zero latency you will get to a point where an app will say, that fine for me. Reduce it further and more apps will drop off the list.
Eventually you will get into areas where the 'law of diminishing returns' takes over. IMHO, this is where we are now. Huge sums of $$$$ etc are being spent to get very little. Sure there is some filtering down into more GP kit but you really do have to aks yourself 'is this really needed? Can I justify the spend to get just that little bit more speed?'
Much like the Space Race, in the end, the answer has to be a simple 'Nope we can't'. When that happens a good few of the companies involved in this area will crash and burn.