Feeds

back to article Facebook throws servers on their back in HOT TUBS of OIL

Facebook is dunking its servers in gloop in a salt shed in Oregon so it can overclock their processors, The Register has learned. The experimental, brutal "immersion cooling" scheme was revealed to us by Facebook hardware design and supply chain bigwig Frank Frankovsky on Friday. Though Facebook had tested out an immersion …

COMMENTS

This topic is closed for new posts.
Meh

Cooling with oil? Not exaclty new

Green Revolution Cooling have been at this stuff a while now. (I do not work for, or am I affiliated with GRC)

http://youtu.be/EZmm7P1mPZs

Wouldn't fancy "servicing" a server though, messy me thinks.

1
0
Silver badge

Re: Cooling with oil? Not exaclty new

You can quickly go back further than that, the Cray-2 famously was immersed in 3M Fluorinert.

Now that was a computer that looked like a super computer was supposed to.

8
0
Silver badge

Re: Cooling with oil? Not exaclty new

It's a little know fact that Harry Ramsdens started off as a supercomputer company that began pil cooling it's machines. Seeking a way of profiting from the vats of boiling oil they began making chips on the side - and the rest is history.

2
0
Silver badge

As long as they don't use the old-school "transformer oil" Polychlorinated biphenyl, which gives you lots of interesting mutations and dioxin on transformer burndown, this could be of some interest.

Recyclers also do not seem to get that these "oils" are not to be fed to livestock....

3
0
Silver badge

PCBs are pretty nasty, and are extremely stable.

They are detectable pretty much all over the planet now. Oops.

3
0
Silver badge

Is it really worth the effort ?

How much CPU time does it take to generate a typical facebook response ? How significant is that CPU time compared to disk/network delays ? What is the cost (build & maintainance) of putting machines in oil ? Would they not be better just installing a few more machines ?

Overclocking is good for long running heavy CPU situations where extra paralellisation does not help; weather forcasting comes to mind.

3
1
JDX
Gold badge

Re: Is it really worth the effort ?

When you have billions of facebook responses to generate, your servers are going to be running at high capacity. That's why FB needs entire datacentres in the first place... if they have 1000 servers and overclocking can gain 20%, that's a lot less servers.

Plus, this is just R&D.

4
0
Black Helicopters

Re: Is it really worth the effort ?

The CPU time won't be used to generate simple HTTP responses. It'll be used for face recognition and other image processing so that they can target advertising better.

Half the photos of you also include your car - sell you motoring stuff. Most of your photos are of you outdoors - sell you hiking boots and waterproofs.

3
0
Silver badge

Re: Is it really worth the effort ?

It'll be used for face recognition and other image processing so that they can target advertising better.

I wish they'd get on with it, I'm eagerly awaiting the responses to "Mature Dating" ads feating a picture of your Grandmother, Mother or Aunty :-D

3
0
Bronze badge

Enjoy testing.

Most components are fine under immersion cooling, but electrolytic capacitors are not. The coolant eventually, slowly infiltrates. Without running the servers for years, it's impossible to assess what the failure rate would be.

1
0

Re: Enjoy testing.

That may be an unexpected benefit of the "fake capacitor" fiasco of a few years back - remember all those bulging/bursting electrolytics which used a (badly) copied formula? I've seen a few motherboards lately (like Gigabyte's "Ultra Durable" range) bragging about using solid polymer capacitors, rather than traditional electrolytic ones with liquid electrolyte vulnerable to the problem you mention.

Besides, when you're buying on Facebook's scale ("We're thinking of filling our new datacentre with your motherboards, will you help us get them working in liquid coolant?") the suppliers have a rather bigger incentive to help than if you or I asked the same question about a home system: I'm sure they'll know, or investigate, what it takes to do this properly. Running a few test systems for years wouldn't bother them, and the component manufacturers probably have a fair idea already: immersion and liquid cooling's not just for PCs, after all.

4
0

Viscosity?

Viscous gloop isn't going to be that great as a coolant. The viscosity just slows down the convection needed to carry the heat away. You need a thin liquid, or even better, a thin low boiling point liquid with a large latent heat of vaporisation. In that case the liquid boils on the hot components. That technology has been used for decades for high-power thermionic valves.

4
0
Bronze badge
Coat

Re: Viscosity?

Or even better - a brick from a night storage heater.

0
0

Re: Viscosity?

Such a phase change, (liquid to gas), can carry large amounts of heat away from hot components, but suffer from at least two drawbacks.

1. Once the coolant is in its gaseous phase it becomes a rather efficient insulator, preventing liquid coolant from having maximally efficient contact to the hot component.

2. The collapse of the bubbles of gaseous coolant can cause the erosion of the surfaces adjacent.

A viscous coolant which phase changes to a more fluid liquid solves both of those problems.

I don't know if that's what they're doing but it's a possibility.

1
0
Anonymous Coward

Tom's Hardware did this 7 years ago

http://www.tomshardware.com/reviews/strip-fans,1203.html

0
0
Bronze badge

Side Effects

It was all going well except the huge urge for Chips (french fries) by tech support

3
0
Silver badge

Frank Frankovsky

Clearly a fake name, who is he working for really?!?

0
0
Silver badge

Re: Frank Frankovsky

Probably for Franken Beinstein, but it's just a guess.

0
0
Bronze badge

cooling won't help with electromigration

Normally, overclocking involves boosting voltage, not just cooling. This leads to increased electromigration, which won't be affected by cooling, and is a major cause of failure under overclocking conditions. I wonder if they're manipulating that aspect at all.

1
0
Anonymous Coward

Obligatory link

I cannot read an article about such cooling methods without remembering the following classic:

http://www.avforums.com/forums/computer-systems/56924-kramer-other-members-promoting-water-cooling-you-have-alot-answer.html

0
0
Mushroom

This sounds familiar...

Cooling a data centre in oil... Didn't Simon write something along these very lines?

Ah! Here it is: http://www.theregister.co.uk/2002/05/11/bofh_and_the_vax_cluster/

Marshmallows anyone?

0
0
Coat

Overclocking

For a better approach, why not use Ethanol and Dry Ice? (And, if things get too bad, the techies can resort to drinking the coolant!). Note that this isn't unprecedented (Err, the Ethanol and Dry Ice, not necessarily the techies drinking it, although that has been known to happen, too!).

There are some mainframe manufacturers who have resorted to using Helium as a cooling agent (e.g., "TCM"). Plus, there has been some work done on using Liquid Nitrogen immersion as a cooling agent for overclocked systems.

Large electrical generators are frequently cooled by Hydrogen gas (It has a low viscosity, so as to not interfere too much with the rotating components, and conducts heat well. Of course, one has to have a very good seal on the bearings, else one runs the risk of the "Hindenberg Effect".).

Dave

P.S. I'll get my coat; it's the one with the Kentucky bourbon and Dry Ice in the pocket.

0
0
Silver badge
Trollface

Re: Overclocking

The Hindenberg Effect - Is that the one where you think you are just over the mountain, and then it all goes downhill, literally?

0
0

There have been many a ham operator down this road. Might look around and find some really cool ham stations that use this.

0
0

But cold isn't fast anymore...

Cold improves transconductance, which used to make logic gates faster.

But cold also increases the threshold voltage, which has a bigger effect these days. So you want your overclocked machine running hot for max speed. This is going to make electromigration even worse though.

0
0
This topic is closed for new posts.