Dedupe is still alive? It never seems to have lived up to its promise somehow, not since those heady days of 2008, before Data Domain was gobbled up by EMC.
Dedupe is a Nirvana, in theory. By now it was supposed to be everywhere: even in ZFS and Linux. One of the problems is that encrypted data can't be deduped, and encryption is becoming the norm in some areas. Corporate desktops (or at least laptops) are now usually encrypted. So is data held in the "cloud".
What happens to a 100TB array if somebody dumps 20TB of encrypted data on there? Do the inline ingesters just dumbly thrash themselves to death trying to dedupe/undedpue it, or do they know what they are dealing with and somehow skip those blocks? Compressed data almost as bad, eg. nearly all media files.
It seems that non-compressed, non-encrypted data will soon be restricted, perhaps, to internal corporate office servers. And who wants to buy a fancy DD SSD array system for that mundane stuff?