Jump to content
House Price Crash Forum

Problems With Hpc Database


Recommended Posts

Hi All,

We have had a major hardware failure at our data centre where we host HousePriceCrash.co.uk and other sites.

The central backplane on our Coraid SR2421 RAID array has failed, such that is is only partially working. We are in the process of moving all sites off of this device on to other devices.

You can read updates on here: http://twitter.com/fubranoc/

Apologies for the inconvenience.

Regards,

Paul

Link to post
Share on other sites

The central backplane on our Coraid SR2421 RAID array has failed, such that is is only partially working. We are in the process of moving all sites off of this device on to other devices.

You have my sympathies. The whole point of RAID is to provide 100% continuity so you must be pretty miffed.

Vendors should do something to make amends. If not, let us know who they are. I'm sure some of the system administrators and budget holders who frequent here can apply some pressure...

Link to post
Share on other sites

You have my sympathies. The whole point of RAID is to provide 100% continuity so you must be pretty miffed.

Forgive me if I'm displaying IT ignorance, but I thought the purpose of a RAID array was to prevent data loss in the event that any one hard drive in the array suffers a permanent failure, from which data recovery is impossible, by ensuring that each bit and byte is written on at least two physical drives in the array. Unless there's double redundancy in the the array controller itself, then if it breaks down you've still lost access to your data, even if the data remains safe and sound on the discs.

But yes, for a mission critical application I'd have expected that pretty much everything would have a duplicate backup.

Link to post
Share on other sites

The central backplane on our Coraid SR2421 RAID array has failed, such that is is only partially working. We are in the process of moving all sites off of this device on to other devices.

Have you tried turning it off and then on again?

Edited by worst time buyer
Link to post
Share on other sites

Forgive me if I'm displaying IT ignorance, but I thought the purpose of a RAID array was to prevent data loss in the event that any one hard drive in the array suffers a permanent failure, from which data recovery is impossible, by ensuring that each bit and byte is written on at least two physical drives in the array. Unless there's double redundancy in the the array controller itself, then if it breaks down you've still lost access to your data, even if the data remains safe and sound on the discs.

But yes, for a mission critical application I'd have expected that pretty much everything would have a duplicate backup.

The backplane failed not the individual drives, the worst IT failures are never the complete failure of an item but the slowly dawning realisation that a dodgy component has been writing corrupt data, I once saw a system where just 2 % of the data had been corrupted but we didnt know which 2% so the whole thing becomes suspect.

Link to post
Share on other sites

The whole point of RAID is to provide 100% continuity ...

No it isn't.

Vendors should do something to make amends. If not, let us know who they are. I'm sure some of the system administrators and budget holders who frequent here can apply some pressure...

No they couldn't.

But I'm sure the sysadmins at FUBRA really appreciate your help here.

Link to post
Share on other sites

The backplane failed not the individual drives, the worst IT failures are never the complete failure of an item but the slowly dawning realisation that a dodgy component has been writing corrupt data, I once saw a system where just 2 % of the data had been corrupted but we didnt know which 2% so the whole thing becomes suspect.

Yuk. Creates that slightly sick feeling and slight sweatiness unique to serious IT problems.

Always seems to happen at about 4.50 on a Friday and usually just after telling your Mgr. how great things are going...

Link to post
Share on other sites

Forgive me if I'm displaying IT ignorance, but I thought the purpose of a RAID array was to prevent data loss in the event that any one hard drive in the array suffers a permanent failure, from which data recovery is impossible, by ensuring that each bit and byte is written on at least two physical drives in the array. Unless there's double redundancy in the the array controller itself, then if it breaks down you've still lost access to your data, even if the data remains safe and sound on the discs.

But yes, for a mission critical application I'd have expected that pretty much everything would have a duplicate backup.

Yep you should have a passive controller ready for seamless failover.

I am trying to get my budget holders to understand this stuff but the conversations go:

1. Do this we will be safe.

2. Great! let's do it.

3. It'll cost this.

4. Oh. Well its not that likely is it?

Link to post
Share on other sites

Hi All,

We have had a major hardware failure at our data centre where we host HousePriceCrash.co.uk and other sites.

The central backplane on our Coraid SR2421 RAID array has failed, such that is is only partially working. We are in the process of moving all sites off of this device on to other devices.

You can read updates on here: http://twitter.com/fubranoc/

Apologies for the inconvenience.

Regards,

Paul

I'm a tad disappointed with the reason tbh. I was working on my conspiracy theory that the government had shut the site down.

I'll get me (tin-foil) hat.

Link to post
Share on other sites

An overlooked problem with RAID is that often the drives are of an identical age and (yea you guessed it) tend to fail at the same time because of this. We had a double failure once because of this, both drives popped at the same time and it took hours and hours to write the backup data back.

Link to post
Share on other sites

True redundancy is very expensive. I once worked with a Tandem machine, where everything was redundant. You could even pull out CPU boards and it would still keep running.

You need that sort of resilience for things like air traffic control and so on.

IMHO it isn't that expensive and microsoft has got better at providing the tools to do it. IMHO you could get it with two server cluster, iis a with SQL Server, probably put it all together for under 50k, you could rip out the CPU on one of the servers and as a user you wouldn't notice a thing (if it was set-up correctly)

Link to post
Share on other sites

Hi All,

We have had a major hardware failure at our data centre where we host HousePriceCrash.co.uk and other sites.

The central backplane on our Coraid SR2421 RAID array has failed, such that is is only partially working. We are in the process of moving all sites off of this device on to other devices.

You can read updates on here: http://twitter.com/fubranoc/

Apologies for the inconvenience.

Regards,

Paul

Thanks for putting so much effort into it, I was beginning to experience withdrawal symptoms...

Link to post
Share on other sites

IMHO it isn't that expensive and microsoft has got better at providing the tools to do it. IMHO you could get it with two server cluster, iis a with SQL Server, probably put it all together for under 50k, you could rip out the CPU on one of the servers and as a user you wouldn't notice a thing (if it was set-up correctly)

In 1983 Sun Alliance were buying shedloads of colour workstations with graphical capabilities for £3000 a pop.

That's maybe £12K each in today's money.

For a 640x384 monitor.

These days it would be a big battle to get a bean counter to spend double that on a pair of powerful servers with total redundancy that would provide core services to 100 people without breaking a sweat.

Pathetic.

Letting the bean counters take control of budgets was the worst thing that ever happened in IT.

Link to post
Share on other sites

I'm a tad disappointed with the reason tbh. I was working on my conspiracy theory that the government had shut the site down.

I'll get me (tin-foil) hat.

"Paul" isn't who he says he is........ :rolleyes:

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
  • Recently Browsing   0 members

    No registered users viewing this page.

  • 439 Brexit, House prices and Summer 2020

    1. 1. Including the effects Brexit, where do you think average UK house prices will be relative to now in June 2020?


      • down 5% +
      • down 2.5%
      • Even
      • up 2.5%
      • up 5%



×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.