back to article Seagate connects Hadoop and Lustre in an open sourcery ceremony

Seagate has written a Hadoop connector for Lustre, meaning Hadoop-using systems can now fetch data from a Lustre parallel file system array, as part of a small contribution by the US data storage company to an open source world. The Hadoop on Linux Connector (HoLC) means that data stored on a Lustre system doesn’t need copying …

  1. tojb
    Unhappy

    Lustre? meh

    Never much liked lustre, maybe it doesn't suit my workloads, or my hardware, or wasn't installed properly. The bumf says that it stripes writes (thence reads) over many disks thus eliminating the bottleneck from only reading X bits per second from a single disk.

    Doesn't fix latency limitations of the drives, and of course adds comms overhead to spread the info around. In theory this should still be good for megamega big files but in practice I and the other admins and developers on our system never got much joy from it.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like