Feeds

back to article World's first petaflops super dumped on scrap heap

Roadrunner, the first supercomputer to break through the petaflops barrier and the first capability-class machine to demonstrate the viability of using specialized coprocessors in conjunction with processors, is having its plug pulled at Los Alamos National Laboratory. It's time to hack in and play Crysis while you still can. …

COMMENTS

This topic is closed for new posts.
Silver badge
Paris Hilton

Maybe Cell power attracted soul eaters from the fifth dimension?

That would be explain glassy-eyed salesdroids. They HAD to get rid of it....

> and a simulation of the universe at a 70-billion-particle scale.

What simulation is that? I know about DEUS-FUR at 549 billion particles running on the CURIE supercomputer in France and the Millenium Simulation series with 10 billion to 348 billion particles.

0
1
Silver badge

Now a new use?

They can put it to use doing nanowire material behavior, magnetic reconnection, laser backscatter, HIV phylogenetics, and a simulation of the universe at a 70-billion-particle scale.

Sounds interesting...

I was going to put an icon up, but I thought better.

0
0
Anonymous Coward

Re: Now a new use?

Problem would be taking it apart, moving it to a new home, putting it back together and then paying to keep it running. If its not running nuclear simulations for the gov they aren't going to cover the bill, what kind of crazy nation spends on science when it isn't science that helps blow people up?

2
1
Gold badge
Thumb Up

Paying to keep it running.

"Problem would be taking it apart, moving it to a new home, putting it back together and then paying to keep it running."

This --^

With the main problem being the paying to keep it running. 2.35 megawatts at 10 cents per kwh would come out to a $2,058,600 a year for power.

Moore's law suggests a similar capability super would now use about 1/8th the power.

I'll look at specs for IBM Sequoia now -- this eliminates some variables, both Sequoia and Roadrunner are from IBM (so it's not comparing a commercial system and a home-built...) and both going to DOE ($$$ markups anybody? $$$). Sequoia does about 16 petaflops in 96 racks... this suggests a (2012-era) 1 petaflop costs about $12 million (versus $100 million for Roadrunner). Power use would be about 450 kilowatts (so power is only about 1/5th instead of 1/8th.)

So, if someone got the system shipped and installed for free, it would be "cheaper" (if you can call $2 million in power cheap) in the short term.. But in 2 years, a 1 petaflop super (following Moore's law) should cost ~$6 million, and be down to about 1/10th the power of the original system (about $200,000 in power bills or so.) In about 5 years, you'd pay more in power in one year than it'd cost to buy a replacement system and the power to run it.

I think CPU/GPU hybrids may in fact run that price and power down several years ahead of schedule too.

1
0

Re: Paying to keep it running.

I agree that Hybrid systems will bring the power/price down much faster, if the performance numbers on the FirePro SM10000 hold up. 1.4T of DP math... uuhh, that's crazy. The Nvidia K20 isn't a slacker either. Since supercomputers by their nature are parallel, GPUs will inherently speed them up.

0
0
Silver badge
Flame

Re: Paying to keep it running.

I've said it before but I'll say it again: Put large 'supercomputer' installations in cold northern cities where the waste heat can be sold on to provide heating for the surrounding buildings. That would reduce the running costs.

Some people will say, "But I don't want to go work in a cold northern city." Well, you don't have to because there's fibre optic comms and the internet.

(Flames: heat - useful and valuable)

6
0
Silver badge

Re: Paying to keep it running.

The heat that comes out of these systems is regarded a low-grade. What this means is that the temperature differential is not high enough to make it particularly practical to use.

Roadrunner is air-cooled (see the picture, spot the hot-cold aisles and no water-cooled rear doors), so the the heat will be picked up by the air handlers.

I've worked with 2 generations of IBM was water-cooled supers, and the output temperature of the water is around 25 degrees centigrade (although slightly hotter for the newer system). This is colder than the ambient temperature of the halls (it's a power concious organisation that is experimenting with running the machine rooms hotter than you would normally expect to save power). This makes it less than luke warm, and certainly not hot enough to even heat the water to wash your hands. The cooling works by cooling the water before sending it to the super (input temperature around 13 degrees centigrade), so the cooling was actually at the wrong end.

Of course, you could use heat-pumps to concentrate the heat, like ground water heaters, but there is a law of diminishing returns operating. If it takes more electrical power to concentrate the head than would be necessary to directly generate the same amount of heat, there is no gain.

0
0
FAIL

Re: Paying to keep it running.

My netbook uses 14 watts, and it wasn't made by IBUM either.

They should use netbooks instead.

0
0
Anonymous Coward

Re: Paying to keep it running.

"What this means is that the temperature differential is not high enough to make it particularly practical to use."

It just needs a separate condenser. Or did Apple patent that already?

0
0
Bronze badge

Re: cooling the water before sending it to the super

There's your heat source then - the refrigeration plant pre-cooler.

0
0
Silver badge

Re: cooling the water before sending it to the super

Even that's not really possible. They use an evaporative cooling system as much as they can (they really are into providing the perception that they use as little power as possible - which could be understood if only you knew who they are). The only time that this cannot be done is when the outside temperature is too high, and this is likely to be the time that heating anything is least required.

I got my information directly from the building power and cooling engineer/manager, and if he can't work out a way of getting something useful back, I'm certain it can't be easy.

0
0
fnj
Alert

Re: Paying to keep it running.

"With the main problem being the paying to keep it running. 2.35 megawatts at 10 cents per kwh would come out to a $2,058,600 a year for power."

Bovine excrement of the highest order. That is chump change. There are 69 million income tax payers in the US (http://wiki.answers.com/Q/How_many_tax_payers_are_in_America). This amounts to 3 CENTS each. A heavy burden - NOT. It's not even noticeable. It's so far below the noise threshold of national spending that it's not even worth one second of worry.

I also predict that your Moore's Law projection down the road is (1) outside the domain of what Moore's Law is actually concerned with (hint: it's not cost), and (2) it is nearing the point of becoming dramatically outdated as physical limits are approached.

Another thing that fairly leaps out of the numbers. The expense to run this item for its full lifespan (so far) is only 10% of the acquisition cost. It's less than the debt service on the investment.

Keep it running as a national resource. Don't even bother SELLING time on it; AWARD time on it to winning applicants based on interesting and useful projects.

0
0
Silver badge
Thumb Up

Just checking in

I had to make sure the obligatory reference to playing Crysis was included.

Good job.

Carry on.

1
1
Bronze badge
Joke

Re: Just checking in

"Crysis? What's Crysis?"

(apologies to James Callaghan, or, more accurately, The Sun's deliberate misreporting of what he said...)

2
1
Silver badge
Boffin

"Think of all the copper"

is not that appropriate as a title for a picture showing fibre cables! Those are fibre Infiniband cables, with electro-optical transceivers (like SFPs) at both ends. The colour is a dead give-away.

Undoubtedly there will be quite a lot of copper in the system, but not in the picture.

1
0
Silver badge
Trollface

Re: "Think of all the copper"

It sure won't be easily gypsy-accessible...

1
3
Anonymous Coward

May get flamed for this but...

can't it be retasked to what it did before?

0
1
Thumb Up

Bitcoin mining

It ought to be good at Bitcoin mining. As long as it does not use too much power.

0
0
Anonymous Coward

Opteron lol

World's last Opteron supercomputer.

0
0

forget Crysis

.. Planetside 2 should benefit much more of all that parallelism, maybe even to planet scale :)

(added benefit is that they can scrap the *side from planetside, leaving planet)

0
0
This topic is closed for new posts.