Yes, but what do you want to do with it?
I mean, lets be honest, HDFS isn't a generalised block storage system. Its not ever particularly well designed for the job it intended to do.
If you want to cluster bits of block storage into one name space, there are many, many better ways of doing it.
For a start HDFS only really works for large files, large files that you want to stream. Random IO is not your friend here. So that makes it useless for VMs.
If you want VM storage, and you want to host critical stuff on it you need to do two things:
* capex some decent hardware (two 4u 60drive Iscsi targets) and let VMware sort out the DR/HA (which it can do very well) 60grand for hardware plus lics. That'll do 300kiops and stream 2/3 gigabytes a second.
* capex some shit hardware, ZFS, block replicate, and spend loads of money on buying staff to support it. and the backups
Seriously there is/are some dirt cheap systems out there that'll do this sort of thing without the testicle ache of trying to fiure out why your data has been silently corrupting for the last 3 weeks, and your backup has rotated out any good data.
So you want a custom solution:
1) GPFS and get support from pixit (don't use IBM, they can hardly breathe they are that stupid) <-fastest
2) try ceph, but don't forget the backups <- does fancy FEC and object storage
3) gluster, but thats just terrible. <- supported by redhat, but lots of usersapce bollocks
4) lustre, however that a glorified network RAID0, so don't use shit hardware <- really fast, not so reliable
5) ZFS with some cheap JBODs (zfs send for DR) <- default option, needs skill or support
Basically you need to find a VFX shop and ask them what they are doing. You have three schools of thought:
1)netapp <- solid, but not very dense
2)GPFS <- needs planning, not off the shelf, great information lifcycle and global namespacing
3)gluster <- nobody likes gluster.
Why VFX, because they are built to a tight budget, to be as fast as possibly, and reliable as possible, because we have to support that shit, and we want to be in the pub.