328 posts • joined 10 Jun 2009
Arghh. Typo alert. StoreAll dickhead writer, StoreAll. Getting it fixed.
Yes you can hear the difference
Sent to me and posted here anonymised:
you can tell the difference, like everybody can.
Take your favourite CD, that does not contain metallic rock or other music with a lot of white noise.
More like acoustic instruments, singing etc, without a lot of cymbals and other white noise producing instruments, will do perfectly
rip a MP 3 of that CD
play the CD and the MP3 player simultaneously, so you can alternate between the two, and hear the difference if any.
You *will* hear the difference, on a somewhat reasonable HiFi installation.
Canadian double-blind test
(Mailed to me:):
In your article on lossy vs. lossless audio you said, "Everything between sample points is lost." Please read up on the Nyquist–Shannon sampling theorem at Wikipedia, which states in part, "no actual 'information' is lost during the sampling process," given certain sampling conditions. This is scientific truth.
Please read the very long and detailed web page at https://xiph.org/~xiphmont/demo/neil-young.html for more information on lossy audio reproduction.
If you've heard of the placebo effect you will understand why people believe lossless audio reproduction MUST be better than lossy reproduction, and hear it as such. But the Canadian Research Council have conducted extensive double-blind (very important) listening tests. At sampling rates 256 Kbps and above, with a good encoding, only golden-ears individuals (that's not you or me or most people) can hear ANY difference at all.
Cheers .... Chris
More from Intel on Pro 1500 Pro 2500 differences
There are a few other differences between the SSD Pro 1500 Series and Pro 2500 Series.
- The Pro 2500 Series is available in the channel (in the 2.5” form factor), while the Pro 1500 Series was not.
- The Pro 2500 Series also includes the Trusted Computing Group’s Opal 2.0 standard (Pro 1500 Series used the 1.0 standard), as well as Microsoft eDrive. -
Lastly, the Pro 2500 Series utilizes a second source of NAND, from SK Hynix. This SSD is the first from Intel to use a second source of NAND.
Intel SSD Pro 2500 Series supports TCG’s latest Opal 2.0 features and is a Microsoft eDrive ready solution while the Intel SSD Pro 1500 supports Opal 1.0 features and does not support Microsoft eDrive. The Intel SSD Pro 2500 Series also supports more Advanced Power Management (APM) with 5 power states and 2 thermal states.
Extra security & channel availability
Anand Tech editor Kristian Vatto says Pro 2500 differs from Pro 15000 by "TCG Opal 2.0 & eDrive compliant plus the Pro 2500 will be available in the channel as well (1500 was OEM only)"
PIty Intel didn't say that upfront. And, anyway, why not add these retrospectively to Pro 1500?
Bay configs wrong maybe
Sent to me and posted here. I;m trying to find out from Storsimple what the actual HW configs are:-
I think those disk capacities are wrong.
The small unit has 10 bays and therefore 5 disk mirrors (assuming your analysis holds). 15TB would be 3TB disks, then. If it's 300GB drives, 1.5TB total storage. Either way - a correction needed I suspect.
The larger unit potentially holds 20 x 4TB drives (10 mirrors @ 40TB) plus SSD.
This was mailed to me,
Chris------> I was at NASA Ames' N258 building (virtual wind tunnel) in 1997 when MegaDrive won the bake off against Clarrion and a couple of others. Not too bad- rebranded LSI Logic arrays- but had some bugs in the backplane that caused data corruption. Still, for the time, decent enough.
Decent guys all in all. DDN, which they became, also decent guys, albeit competitors when I was at Xyratex a couple of years ago.
(Name with held)
EqualLogic and ARM
Surely EqualLogic uses X86 controllers?
Re: Hmmm... there are appear to be somewhat conflicting opinions on this development at Reg central
News report vs blog opinion....
Wow Trevor, just wow! An $8 billion- $10 billion valuation is .... well, wow!!
I enjoy mowing grass Trevor :-)
Here's more info from CTERA:
I should note that we support more than what is immediately available on our website… we need to update that :)
Amazon S3, Amplidata, Caringo, Cleversafe, Cloudian, DDN WOS, EMC Atmos, EMC ViPR, Hitachi HCP, IBM GPFS, OpenStack SWIFT, Scality.
With more to follow…
Additionally ... we have our own sync & share client that co-exists with our backup client so customers can manage backup and sync from one central system where the cloud is optionally extended by gateways (that also feature NAS support) - gateways are used when a customer wants LAN-level performance and low latency of data access.
BTW – you might have seen this one this week; Orange Business Services Launches CTERA-based Flexible Cloud Storage.
With 8M business customers at Orange, this is a tremendous validation of the platform.
(All this comes via mail from Jeff Denworth.)
I'm enjoying my education here :-)
Re: prize another £599 from my wallet
Prise and septic tank comment - that was magic!!!
Actifio and IBM SVC
Well, well, well; a couple of Twitter people have pointed out that Actifio and IBM are connected; "The Actifio Protection and Availability Storage (PAS) appliance includes SVC code. The PAS platform spans backup, disaster recovery, and business continuity among other functions." (Wikipedia.)
This webpage, dated Feb 2012, (http://mspmentor.net/managed-storage-services/actifio-ibm-partner-virtualized-storage-target-msps) is entitled "Actifio, IBM Partner On Virtualized Storage, Target MSPs." It says Actifio is producing a turnkey offering in partnership with IBM.
Data here - http://www.actifio.com/products/product-line/ - on Actifio 100T product line.
Re: We've had to save up our pennies
Sadly not. Though a Playbar might be coming that way...
Re: SUBstance abuser
That's mid-range? Sheesh!
Loved the comments, especially audiophile = hifi enthusiast with credit card. The whole set of comments has opened doors into music playback fields I didn't know existed. Sort your room out before sorting the audio out - that notion is, well, interesting. Music playing in my house is something we do in a room alongside other things - eating, reading, TV, meeting friends, chilling out and so on. It isn't just a listening room.
But I have got to listen to a high-end audio system to see/hear the difference. Are there demo centres anywhere near Croydon, UK I could visit?
Well no. But a good wind-up comment.
Ah, never realised that matt black version was a time-limited offer. Couldn't see it had ever happened anyway.
Re: Virtual purchase
Oh. Bach to my sources - sorry.
Pair iof Play:3s. Before that a cheap Sharp surround system. Progression is a wonderful thing.
Re: Virtual purchase
Should Seagate offload Xyratex disk array business
Seagate is buying Xyratex and gaining:-
1. HDD manufacture test equipment business,
2. Storage array disk enclosure business with customers Dell/EqualLogic , HP/3PAR and IBM XIV & StorWize,
3. ClusterStor HPC storage array business.
Seagate spun out its previous disk array business as Xiotech in Nov 2002. It sold its disk-enclosure-focussed Advanced Storage Architectures group to Xiotech in Nov 2007. Now it's back in the storage array OEM and end-use business. Should it be? Should it just offload the disk enclosure business and ClusterStor businesses to X-IO (renamed Xiotech) and I've that form a better growth path for its revenues?
Mark Lockareef says
From Mark Lockareef:
Just read your most recent article on Nexenta. As you know, Evan did a great job building the company in the early days but needed to pass the baton onto a leader that could take the company to the next level. I joined Nexenta as our interim CEO in February to help the company find our next permanent CEO. You state that I "departed in pretty short order" but I was actually the interim CEO for 7 months...longer than I expected to find the permanent CEO (I thought my role would last about 3-4 months). Turns out that great CEO candidates in the next-generation storage space are few and far between. We actually got a lot done in those 7 months wrt building the foundation for growth. Now that Tarkan is on board, it will be fun to watch how he continues the story.
Just wanted to make sure you got the straight scoop.
Death of the business Desktop
The business PC desktop is facing death by a thousand VDI cuts augmented by a BYOD bashing.</p>
<p>Business desktop death pointers:</p>
- EMC’s XtremIO all-flash array, twinned with VMware View or Citrix Xen Desktop and backend VNX arrays, can support 7,000 or more virtual desktops
- All-flash SolidFire arrays can support large-scale, 1,000+ VDI roll-outs
- Atlantis and all-flash Violin arrays can support 1000s of virtual desktops
- Hybrid flash/disk array startup Tintri can support 1,000s of virtual desktops
- Startup Pivot3 supports VDI
- There is a VDI-focussed Vblock from VCE
I know this is repetitious; that’s the point. These aren’t just a few pointers; this is a flood, a veritable tidal wave of systems all focussed on removing pricy and complex-to-manage business desktops with centralised virtual desktop systems.
Some other suppliers with VDI capabilities; Pure Storage, Tegile, Nimble Storage, and Fusion-io. A combination of flash storage and deduplication is making it possible for cost-efficient and storage capacity-efficient VDI set-ups with the responsiveness of actual desktops, or better.
Set this VDI blitzkrieg to one side and consider BYOD - Bring Your Own Device, in which users bring their own notebook computers to the office. This is the guerilla war assaulting the business PC with VDI being a full-on, frontal assault.
The net result could be a multi-year reduction in business PC use with, in some businesses, desktop PCS literally disappearing.
We haven’t any numbers, beyond the general PC annual shipment numbers decline. Our sense of it is that the business desktop is an endangered IT species facing year-on-year shipment declines, wilting under the impact of artillery barrages from the massed ranks of VDI howitzers and BYOD sharpshooters.
In that case there will be a consequent decline in business PC component shipments; hard disk drives, power supplies, DRAM, motherboards and CPUs.
If 200,000 business desktops go away each year for five years that’s a million fewer hard drives shipped. And it could be worse; 500,000 fewer desktops each year means 2.5 million fewer drives over five years.
I think we’re at a VDI/BYOD tipping point and a storm surge of virtual desktop instances is going to wash increasingly unwanted and unloved business desktops right out of the offices they’re anchored to, never to return.
Is this true? Will it happen? Am I smoking pot?
I think not Sherlock.
The SMART flash DIMM announcement opened up a major server memory redesign period. The idea of packing NAND chips tightly together and accessing them in the same address space as main memory is highly attractive to server manufacturers looking for an edge in running applications faster, faster than PCIe flash for example.
SanDisk has bought SMART and now has a DIMM future (sorry). My understanding is that all the major server suppliers are looking at non-volatile memory DIMMs and designing future servers with storage memory, and not just with NAND but envisaging post-NAND technologies such as Phase Change Memory (PCM), Spin Transfer Torque (STT) RAM or some flavour of Resistive RAM (ReRAM) technology.
This technology transition will make storage memory byte- instead of block-addressable; the programming model would change. There would need to be a software layer, like Memcached, to present storage memory as pseudo-RAM to applications
We could think of X86-populated motherboards populated with storage memory DIMMs.
Cisco’s UCS servers are known for having large amounts of RAM. Building on its Whiptail all-flash array acquisition it would not be surprising if Cisco were to announce storage memory-using servers in 2014. We’re surely going to see Whiptail arrays using UCS servers instead of the Supermicro mills they currently employ.
Dell, IBM, and HP server engineers and designers must be actively looking into the same storage memory technology.
And it’s not just server manufacturers. Storage suppliers with an interest in PCIe flash are also looking at this topic. For example, I’m convinced that WD with its Virident PCIe flash acquisition is looking at the field, as well as Fusion-io. There is a go-to-market issue for the non-server suppliers, as in, who do they sell to?
Do they pursue IEM deals with the server suppliers, or retrofit deals with independent system vendors?
Moving on, in some scenarios a bunch of clustered storage memory DIMM servers with could avoid the need for an external flash array and talk to persistent external storage disk drive arrays for bulk capacity.
I’m seeing storage memory DIMMs as predominantly a server supplier play, and one that limits the applicability of all-flash arrays. Am I smoking pot here? Have my hack’s table napkin-class ideas gone way past reality? Tell me what you think is real here - and if reality bites my ass then I’ve learnt something, which will be good.
Re-purposing old arrays
A German IBM customer, the Ernst Strüngmann Institute (ESI) for Neuroscience of Frankfurt., has dumped the EMC/Isilon O/S from three 36NL nodes and replaced it with SUSE Linux with IBM's GPFS as a filesystem.
Each node has 36 internal disk drives in a RAID-6 configuration. The InfiniBand adapters involved work with RDMA enabled for native GPFS - version 220.127.116.11 to be precise.
In effect old - 2011 era - not that old - Isilon hardware is being re-used in a 3-node cluster to function as a 55TB filestore using IBM software. Cool.
Are their other examples of storage array re-purpising that beat this in coolness factor terms?
3D Read/write heads
Would it be theoretically possible to 3D print a disk drive read:write head?
I think you'd need a 3D printer that could print small numbers of molecules ...
Answers on a postcard ..... to this forum please.
BT's press office sent me this note:
How much free storage you get is dependent on what package you choose, Unlimited Broadband extra and Unlimited BT Infinity 2 customers get 50GB:
StorageTek not Sun
Sent to me so I'm passing it on:
Randall Chalfant was at StorageTek when acquired by Sun. Looking at his dates of service, it would be more accurate to identify him as ST rather than Sun.
Seems unlikely he was deeply connected to any of the ZFS work which was all done in CA at the time.
Re: Is this article just the result of being sloppy or is it a blatant shill?
No shilling here. My info is that WD Reds have 5400-5900 rpm through Intellipower and so aren't true 5900rpm drives. Are you saying yours is 5,900rpm constantly? In which case my files are wrong :-)
Re: WD 5900rpm
I have WD's 4TB Red drive going at 5400-5900 with Intellipower so I didn't class them as a true 5900rpm drive.
What's an enterprise SSD sale?
Does building SSDs for your own use count as an enterprise SSD sale? Gartner says it does and includes Google as an enterprise SSD supplier with a revenue share because it builds SSDs for its own use. Is that right?
Hook, line and sinker
Sent to me anonymously:-
Congratulations on taking the press release bait hook, line and sinker. This really is a complete troll release.
Do I have to spell it out to you? They're claiming they can be "maintaining up to 100 per cent bandwidth utilisation", which means simply stuffing the line as full as it will go. This is empathically not a design goal of rsync, quite the opposite really.
If this is their design goal then they ought to try and compare with bittorrent, a protocol designed to exploit weaknesses in TCP's ideas of "fairness" (confused? ask Andrew for the Briscoe paper redux) to stuff the line as full as it will go.
By contrast, rsync tries to reduce the need to transfer anything to the absolute minimum, preferring to leave the line idle while it works out what can be safely skipped. So this comparison is a little dishonest, to be quite unduly charitable about it.
Yet you bought it and wrote a nice little piece regurgitating their lies. How nice.
Amount of DRAM cache
1GB of DDR3 DRAM cache. That was left out - oops!
Are SPC Benchmarks useful?
A commentard ripped into me over the HP SPC-1 benchmark win story - No Dell, no EMC? Well, HP's storage champ then.
Here's what the comment said (between arrow lines):-
You're kidding me right?
Chris, have you even read the specs of the arrays you're drawing comparisons against? Do you understand how the SPC benchmarks work and the impact particular type of resources have on the different workload profiles used?
Storage performance and scalability is large dependent on a number of different resource types and the ability to distribute different types of workloads across available resources (utilization rate).
From a workload distribution perspectives in simplistic terms we can think about frontend and backend. For the frontend, the 3PAR 7400 is using more FC ports than both the V7000 and the HUS150. We could get extremely technical on the impact more ports yields from a buffering and queuing perspective, but I think its pretty clear that more ports ultimately means that a host can process more I/Os in parallel.
From a backend workload perspective it more about the disk to offload the workload to. In some workloads profiles its almost always about the disks, with others parts of the I/O chain in-between almost running at line speed. The 7400 again has more disks (SDDs) than both the V7000 and the HUS150, in both cases we are talking double digits more and at 2500IOPS a pop thats 25,000 raw IOPS we can handle without cache! .
When it comes to dealing with the different workload profiles cache (for all but random read workloads) is king, a well designed array's performance scaling profile is based largely on this single resource type all other things being equal. The 7400 has more than 4 times the amount of raw cache than the V7000 and double the cache of the HUS150 When it comes random reads SDD is our saviour and as I said above, we have more SSD spindles in the 7400.
SPC comparisons that are designed in this way prove nothing. Please stop harping that X is better than Y because you've looked at some summaries at the SPC website, its false (performance) economics and just wrong.
So the SPC-1 benchark result summaries are not a valid way of comparing different vendors' systems.
The SPC web site home page includes this text; "SPC-1 benchmark results provide a source of comparative storage performance information that is objective, relevant, and verifiable. That information will provide value throughout the storage product lifecycle, which includes development of product requirements, product implementation, performance tuning, capacity planning, market positioning, and purchase evaluations. The SPC-1 Benchmark is designed to be vendor/platform independent and are applicable across a broad range of storage configuration and topologies."
The vendors agreed the SPC-1 benchmark and submit systems to it and publish results. So it's valid, I strongly submit, for us hacks to write about them. In other words I disagree with the comment above.
Is that a reasonable line to take?
Re: Actually, yes...
This is all getting interesting and I think I'm getting polite wrist slaps from people who say the demand for in-array processing is more complex and more widespread than my simple little article says.
Yes, okay, it is. And, yes, okay, the idea of a storage array with spare server engines running VMS looks good and sensible .... but will Cisco, Dell, HP and IBM, who own most of the server market between them, do this?
It's okay for EMC and DDN and Violin Memory to push the im-array processing idea because it marks out their arrays as having more value but general adoption needs a big system vendor to jump on board and, so far, none of them has.
In-array compute ....
.... is not going to fly. If networked storage takes too long to access then bring it closer to the servers. Don't start putting servers in storage arrays; that's like putting a car's engine inside its petrol tank. If fuel takes too long to get to the engine bring the petrol tank closer to the engine. Simple.
In-array compute is a dead duck, a dodo, an ostrich, a bird that isn't going to fly except in small market niches where buyers are array-centric in their approach rather than server-centric. To mix the metaphors, in-storage processing is for the birds.
Is this view pot-smoking or realistic?
Lay-offs took place
I was told by one person anonymously that 900 people were laid off by NetApp in US yesterday, mostly older people. It's not verified.
NetApp layoffs insane
NetApp is no longer the best place to work. Their latest layoffs include a number of long term senior CLOUD strategists and Enterprise Architects who were hired to help provide the company with direction and focus on Cloud.
One can only assume, that the entrenched incumbent sales leaders have stuck their heads in the sand, preferring to continue to sell in outdated modes, via storage based solution sales, rather than helping their partners and their channel design and build truly competitive Cloud services. Their ignorance of Service Strategy, Design, and the basic tenets of ITIL and ISTM will well serve their competition well, and white box storage behind well designed Cloud Services based on Open Source will continue to eat their lunch.
Sent anonymously to me.
HDD vendor way back
Your piece on the death of traditional HDD vendors is interesting, but I wonder if there is a way back for the likes of Seagate and WD? It seems to me that today we have something of a cartel on the supply of flash memory chips, as a result of which we see artificially inflated prices for emerging SSD drives (£350-£450 for a Samsung 840 Pro 512Gb, for example, which is many multiples the price of a top-of-the-range 2 or 3Tb HDD).
This is because the emergent dominant players in this market are currently milking it for all they are worth. It's often the way, and if a market stagnates with 2 or 3 major players, we see little or no commercial pressure to innovate or reduce prices (think Microsoft in desktop, or even say Canon/Nikon in cameras, Nintendo/Sony/Microsoft in games consoles, etc,etc ).
So a possible route back for Seagate and/or WD would be to purchase a Flash Memory fabrication plant and then run out a line of decent quality drives that seriously undercut the existing cartel. Give the market say 1Tb Flash drives for an initial £500 [aiming to drop to £400 when the inevitable fightback begins] and there's the chance of winning back market share.
If they wanted to do this, Seagate/WD could fight back with say last year's SSD technology (one die size large fabbing, slightly lower clock rates) which may enable them to buy up fabrication gear on the cheap. They won't be able to compete with Samsung/Kingston/etc in performance terms, but as long as they offered a drive that was markedly faster than the best HDD and seriously undercut the cartel, they may succeed.
The one thing SSD doesn't have today is a high-capacity drive. Samsung/WS could do it. Question is, after the relatively recent floods in Thailand, and the time, trouble and effort they undoubtedly put into recovering their HDD fabrication capacity, have they got enough left in the tank to scale up a serious SSD challenge. I suspect we'd learn that the flooding is a much larger factor here than merely being caught asleep at the switch...
[Sent to me]
Re: Are Disk Drive Vendors screwed (by flash)?
Me too TeeCee. I'd have hight hybrids (SSHDs) would be being taken up by tablet and ultra-thin notebook makers enthusiastically.
Are Disk Drive Vendors screwed (by flash)?
Read Mike Shapiro's view that HDD vendors are screwed by flash (included bellow). What do you think?
- Is Seagate clawing its way back?
- Is Toshiba sitting pretty with NAND foundry and HDD manufacturing operations?
- Can WD claw its way back?
- Are hybrid SSHDs enough for the HDD vendors enabling them to effectively ignore SSDs?
------------------------Mike Shapiro interview-------------------
The disk drive vendors have been utterly screwed by mismanaging the disruptive force of solid state drives: that's the view of Mike Shapiro - lately a storage bigshot at Sun and Oracle.
Mike Shapiro was a Sun Microsystems Distinguished Engineer, CTO, and VP of Storage for Sun and then Oracle. He is most recently a founder at a stealthy storage startup about which we know nothing. We spoke to Mike about his views on flash drives and the HDD suppliers.
El Reg:Did the disk drive companies enter the solid state market in a timely manner?
Mike Shapiro: Despite the emergence of STEC as the first enterprise SSD vendor in 2006 (when we first talked to them at Sun) it is remarkable to me that Seagate, HGST, and WD all failed to enter the SSD marketplace until 2011 (5 years later, by which time it was essentially too late). And when they did, they did the obvious dumb thing of pricing the SSDs above the 10k and 15k RPM drive lines - i.e. they made the classic error of thinking that they could solve a disruption by just organising their own revenue streams regardless of other market forces.
El Reg: So what happened?
Picture of Mike Shapiro, Bryan Cantrill
and Adam Leventhal
Mike Shapiro:As a result of this massive screwup, a raft of solid state drive companies entered the market, which in turn I believe spurred the NAND vendors to say, 'gee, if that's all it takes to mark up our NAND, surely we can do a better job of that'. Furthermore, the NAND companies are entirely staffed by ex-DRAM people whose major lesson in life was that DRAM was killed from a margin point of view by letting someone else (the x86 CPU) commoditise the interface to it. So the idea of keeping the deep NAND interfaces secret, building their own controller or firmware or drive, while doling these secrets out very cautiously, made sense.
El Reg: Can you split SSD market development into phases?
Mike Shapiro: So we really see three phases of the SSD market using the rear-view mirror -
(1) STEC creates the market (first customers EMC and Sun)
(2) Startups enter the market, partnered with the NAND suppliers
(3) NAND suppliers become SSD suppliers, kill off startups (and STEC)
El Reg: How did the HDD suppliers mis-read things?
Mike Shapiro: How different it might have been if they (HDD suppliers) had acted in stage (2) Furthermore, the disk vendors assumed that all of their volume (i.e. small servers and laptops and desktops) would come from the 2.5in disk drive form factor for client [products] and would become the dominant form factor around 2009-10. But instead, thanks to cloud and tablets and iPhones, that entire transition has in fact been killed - the server market is in decline. All of the mobile computing and devices use 100 per cent flash, and so in fact the remaining use case for disks will be 3.5in (bulk storage).
El Reg: Bulk storage disk drive sales prospects look okay though?
Mike Shapiro: [Yes] thanks to the hyperscale customers like Google and Facebook and Apple, the market for bulk disk is now a direct sale (i.e. literally directly to the end customer) rather than an indirect one (through HP, Dell, IBM, Oracle etc). So we see an ability for the HDD guys to (temporarily) grow margin as they adapt to this opportunity, yet over the long term the opportunity to keep their position in the volume client storage device business has been entirely squandered.
El Reg supposes that Shapiro's criticisms are directed mostly at Seagate and Western Digital. The third HDD supplier is Toshiba and it operates flash foundries in partnership with SanDisk. Seagate has just widened its flash storage offering with three SSDS and a PCIe card powered by Virident, and Seagate is now almost 10 percent owned by flash foundry-operating Samsung. WD has an investment in all-flash array startup Skyera and is expected to widen its SSD range soon.
Can Seagate and WD catch up? Shapiro would think not. They are utterly screwed. ®
I reckon if CommVault's share price is realistic then EMC is dreadfully under-valued by the market. On the other hand the opposite could be true! I just can't make sense of it.
Why have CommVault shares outperformed EMC's?
Although CommVault and EMC have both exhibited steadily climbing annual revenues and profits CommVault shares have outperformed EMC's. Why? Are investors and the stock market commentators, analysts and influencers crazy?
A coming story about CommVault's results has charts that show the two company's annual results and their share price movements compared. How is it that their share prices have moved so differently?
From Paper's author Mario Blaum
in your note you write: "The paper, by IBM Almaden researcher Mario Blaum, professes to solve a problem where RAID 5 is insufficient to recover data when two disks fail."
This is an incorrect statement. I never say that in the article. RAID 5 cannot recover data when two disks fail. For that you need RAID 6. The problem addressed in the paper is one disk failure and up to two "silent" failures in sectors. That is, when a disk fails and you start reconstructing using RAID 5, you may find out that you cannot read a sector, and then you have data loss.
In order to handle this situation, people use RAID 6. But this is a very expensive solution, since you need to dedicate a whole second disk to parity. For that reason, we developed the concept of Partial MDS (PMDS) and Sector-Disk (SD) codes, which have redundancy slightly higher than RAID 5 but can handle the situation described.
Let me point out that Microsoft researchers in the Azure system came up independently with a similar solution, though the application was different (our main motivation was arrays of flash memory). Both the IBM and the Microsoft solutions involve computer searches. A theoretical solution was an open problem, which I provide in the paper you mention. The solution involves mathematical concepts like finite fields (to which you refer ironically as a mathematical side line with no real world applicability). I will make no apologies for the math and you are certainly free to believe that this is just a mathematical curiosity. However, we recently presented our results at FAST13 (Plank, Blaum and Hafner) and there was great interest. Jim Plank and I are preparing an expanded version under request for ACM. Best regards.
Nail. Head. On the. Hit.
I couldn't understand the paper as I don't have 90 per cent of the maths knowledge to do so - cerebral insufficiency. Mario couldn't explain it to me so I could understand it because of my limitations - so that would be no use in trying to get the paper's contents described on the Reg'.
This way is much better - and more fun.
- Product round-up Too 4K-ing expensive? Five full HD laptops for work and play
- Review We have a winner! Fresh Linux Mint 17.1 – hands down the best
- Vid Antarctic ice THICKER than first feared – penguin-bot boffins
- 'Regin': The 'New Stuxnet' spook-grade SOFTWARE WEAPON described
- You stupid BRICK! PCs running Avast AV can't handle Windows fixes