Ouch

I had a tour of Telehouse in Docklands a few years back. The amount of stuff in there was mindboggling and I'm sure has increased dramatically since. It seems daft to have all this stuff in one place, even if there is theoretical redundancy with other sites.

Blundering workmen?

Or blundering planners? The workmen might have been digging exactly where they were told as far as I can tell. Not that I'm a shovels & bum-cracks fan, but it seemed a tad presumptious to blame them just yet.

Paris, because when her hole's being dug she's happy to show everybody the evidence.

Isnt the point...

... that the internet is a distributed network where packets will route via whatever routes are available?

Doesn't this mean that either:

a) 100% of traffic for these providers can ONLY route via the link on the docklands (ie: no other routes physically exist... which surely would be strange for large providers to have no backup links)

or

b) something is really screwed up with IP in the UK (IP as in TCP/IP ... not intellectual property)

Paris - because dockland workers are a big fan of hers.

Hurr

GX and O2 are based in Global Switch, not telehouse.

12 Hours to Fix.....

Some of our Branches up north were affected by this. Birmingham, Leeds and Manchester all went down at 1pm. Spoke to our provider (who is provided by GC) several times and was told they had to repair 200m of fibre cable!!! From the email I got this morning from our provider it took 12 hours and came up at 3.30am!!

C4L

Surprised they knew their arse from their elbows. They are the biggest group of incompetent idiots I have ever had the mis-fortune of dealing with.

Typical UK

Everything routed through the centre of London. Why?

Internet - distributed network.

Britain = London = Me, me, me

Everything in this country seems to depend on the arse end of the bottom corner of England.

Heheh I can hear the conversation now...

"Hey Steve, I gotta bloody tough tree root here"

"Then get the pick axe on it Jo"

*thwack*thunk*Bbzzzzttt*

"Oops...."

(yeah ok, it may not have made a short circuit sound but for comic strip effect....)

Mines the one with the detailed map of cable, pipes and anything else important in the pocket.

@ Loki

HA Ha Ha, You dont work in Telecomms do you?

"a) 100% of traffic for these providers can ONLY route via the link on the docklands (ie: no other routes physically exist... which surely would be strange for large providers to have no backup links)"

Ha Ha Ha Ha, Now back to planning that new 60 Gig flattened "ring" (where the main and protection fibres arent just in the same duct but in the same cable!

AC, because

@Loki

That's right the magic pixie dust helps those packets get to there destinations all on there own, you click a link to the register and all you packets just magically fnd there way there, just from your pc.

Can we have a bang head against desk icon...

PS read the article, it didn't go down, it slowed down.....

@Dave Edmondston

Hmm I wonder why.....maybe everything goes through London as...

1. Its the Capital of the UK

2. Its the Business Heart of the UK

3. Its where all the Major Businesses are based

4. The South Coast has the UK's Silicon Valley (London to Newbury to Guildford and everything in between.

5. Its the capital and heart of everything as its closest to Europe

Yes Manchester, Edinburgh, Newcastle, etc, are all big cities but frankly none of them are as vital to the economy as London. The same argument can be said of any nations capital.

Paris......as she loves mens cables, and deep dark holes ;)

Backup links

its makes me laugh when i hear these isp's are affected, my company use GX which was fibrenet and had our link knocked out, but like many of our other suppliers who also were on this fibre we just moved into a at risk state, running on the other part of our ring... you have to question how tight these isp's are being as the cost of cross london darkfibre is cheep as chips..

@Dick Lovewell

Dont know what is funnier, your comment about the cracks or the Paris one. Good one.

Diggers, doing it for fun

I have two digger stories, one strangely in docklands. The g/f's sister is a geo technical engineer, and was working on a site not far away from Yeo Street, and told the driller (ok, not a digger, but close) right *there* cos it's safe, look at the council supplied plan, there's only London Clay there. Next thing *kzzzzzzzzrt!* and one driller thirty foot away. They'd found a very large electricity main that no-one, not even London 'leccy/EDF knew about.

The second story concerns a council in the Midlands, who had their server room in the basement of the building. Not only did the diggers manage to sever all the comms and electricity lines, they also when through a water main and flooded out the server room. Oooh how we laughed when we took that support call!

@ Pete James

you mean the the police _actually_ started work?

now c'mon we try to be realistic on here mate - there is NO way the useless t*ssers moved away from checking speed camera films!

why docklands?

It's all about power, that's why.

Reminds me of a joke...

(That I think I saw here.)

How does a network engineer lost in the desert get rescued?

They bury 5 metres of CAT5 and hitch a ride home with the JCB driver.

Here all week, tip waitress, veal etc.

Mines the one with the 5 metres of CAT5

hurr

Any telco/network provider worth their salt *does* have resiliency though. We certainly do, just diverted traffic around the other side of our ring and customers were reconnected within minutes.

The maps are shite

Anyone who has any experience in these matters will know that all these cries of "stupid hairy arsed navvies should have looked at the plans" are just bollocks. No doubt, workmen do occasionally mess up, but you should see just how fucking useless these plans are - both the councils and the utilities very often don't have the slightest fucking clue what's where under the road, their plans are totally inaccurate and hence next to useless.

Just take a moment to think about how often your own wiring plans in server rooms and elsewhere are totally unrepresentative of reality - then bear in mind that these guys are dealing with all that wiring buried under layers of tarmac, concrete and muck.

Not that any of you are going to listen to this.

Strategicaly speaking ...

.. it seems fairly stupid to have major data systems based near a large river, liable to flooding, in the centre of a city that could be a prime target for terrorist attacks.

It would be better to have our main data systems somewhere deep underground in a geologically stable part of the UK. There are plenty of old mines that could be used, as well as all those "not so" secret Nuclear bunkers....

over reliance on london docklands

I agree with the concerns on the over reliance of that location for out internet transit, something like 90% of isps are based there and pretty much all the mainstream uk websites, just about all uk internet transit is routed around that area. To some it may seem fine as london is the capital but if that location was to be bombed tommorow we would be up s*** creek connectivity wise.

If you look at germany as a comparison they have major POP's in all their major cities, frankfurt, berlin, hamburg etc. with datacentres scattered around the country. Planned datacentres in sheffield and peterbrough cant come soon enough but we also need some serious major transit laid down so we have other major POP's outside london and manchester.

How many tier 1's have fibre going through a POP outside london in the uk?

"No electromagnetic leakage to detect and betray it's presence."

Well, there's a thought. It probably wouldn't cost much (relatively) to include a bit of conductor in the cable or trunking just for that purpose.

It wouldn't even have to be permanently energised, just turned on when work was needed in the area.

Quick, lets get an anti-patent on the idea, otherwise some country with a backward patent office will fail to spot the obviousness of the idea and the idea will be priced out of the market.

Hmmm, does publication in El-Reg constitute an anti-patent? If the page is indexed by archive.org then surely the idea becomes public domain and ensures that such a patent could be disputed as "already in the public knowledge" before the patent was applied for ???

Its still SLOOOOOW

Has been for the past couple of days and doesnt seem to be getting much better, I usually get 14 megabits down, service is now intermittent at best.

The old Q diagnostic center would have been nicd to use on this

But too bad they were bought out and the lead programmer for the network tool still owes me $7.

Predicting this kind of network downtime is impossible.

Plans? We don't need no plans!

Plans say "dig over there, that's where you are supposed to put the cable."

Workmen say "That ground's too rocky but there's clay this side of the street. We'll stick it in over here, nobody will ever know the difference."

Proof? Bundles of cables and pipes in the right place, just a few in the wrong place... not necessarily in this instance (was it?) but just look down practically any street in our sceptic isle.

Danger! Fsckwits at work!