The Channel logo


By | Gavin Clarke 25th November 2015 17:33

Fingers crossed tomorrow morning for Telecity's third repair shot

In the new circuit breaker we trust

UK internet hub Telecity on Thursday plans its third shot at fixing a power systems problem that fried customers' servers.

According to an email seen by The Reg, Telecity’s chiefs have scheduled a three-hour window between 01.00 – 04.00 GMT on 26 November to fix wonky power phasing at the firm's Sovereign House data centre.

But Telecity engineers will only swing into action if testing of a brand new circuit breaker that’s been ordered proves successful.

The circuit breaker had been due to arrive at Sovereign House, site of a damaged UPS that’s causing so many problems, on Tuesday. Thursday morning will be the third attempt to overcome the problem at the facility in the Docklands.

Engineers will use their repair window to rectify the power-phasing problem, which emanates from a transformer with a phase-changing problem that was accidentally introduced by an engineer on the afternoon of 17 November. The issue produced a spike that felled one of Sovereign House’s two diesel-powered UPSs, and fried the hardware of customers attached to it.

Such was the outage that it produced a noticeable dip in the UK’s internet traffic, taking out or slowing cloud services and VoIP phone systems of customers based in Sovereign House whose systems depended on the UPS.

Telecity has tried twice before to fix the problem but succeeded in only making more power cuts.

An ambitious attempt to “seamlessly” switch customers to a portable diesel UPS, brought in and parked in the Sovereign House car park late Sunday night/early Monday morning this week, also failed.

Without any UPS, customers servers have been running on raw mains power – meaning they have no protection against spikes and outages from the grid.

Again, Telecity did not return request for comment for this article. ®

comment icon Read 23 comments on this article or post a comment alert Send corrections


Frank Jennings

What do you do? Use manual typwriters or live in a Scottish croft? Our man advises
A rusty petrol pump at an abandoned gas station. Pic by Silvia B. Jakiello via shutterstock

Trevor Pott

Among other things, Active Directory needs an overhaul
Baby looks taken aback/shocked/affronted. Photo by Shutterstock

Kat Hall

Plans for 2 million FTTP connections in next four years 'not enough'
Microsoft CEO Satya Nadella


League of gentlemen poster - Tubbs and Edward at the local shop. Copyright BBC
One reselling man tells his tale of woe