Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase 12»»

The DR Test Schedule Expand / Collapse
Author
Message
Posted Thursday, October 6, 2011 10:44 PM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Today @ 8:51 PM
Points: 33,266, Visits: 15,431
Comments posted to this topic are about the item The DR Test Schedule






Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #1186911
Posted Friday, October 7, 2011 2:20 AM
SSCommitted

SSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommittedSSCommitted

Group: General Forum Members
Last Login: Today @ 3:52 AM
Points: 1,639, Visits: 5,617
The issue I have is: working for a small company, it's not so easy to lay hands on an unused server we can use to restore our data! Heck, even keeping spare mice and keyboards in stock seems to be slightly beyond the pale as far as the beancounters are concerned...
Post #1186961
Posted Friday, October 7, 2011 6:24 AM
Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Friday, August 22, 2014 12:43 PM
Points: 581, Visits: 732
The issue I have is: working for a small company, it's not so easy to lay hands on an unused server we can use to restore our data! Heck, even keeping spare mice and keyboards in stock seems to be slightly beyond the pale as far as the beancounters are concerned...


Although it can be difficult to procure the items necessary for a good DR system, in your situation, it is important to document the repeated attempts. If things ever blow up, and I hope they don't, you can at least tell them "I told you so."

Thanks for the article,

Matt
Post #1187033
Posted Friday, October 7, 2011 6:30 AM
Say Hey Kid

Say Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey KidSay Hey Kid

Group: General Forum Members
Last Login: Today @ 6:18 AM
Points: 662, Visits: 1,671
While I don't have the responsibility for these servers, we do have images of them, as well as regular backups, and I suspect we could recover them fairly quickly. Maybe I should ask for a test someday soon….


Why not during PASS?

If the junior DBAs at home can't pass a DR test while the "elite/MVPs" are out of town, then your DR plan is a failure.
Post #1187039
Posted Friday, October 7, 2011 6:45 AM
SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Monday, May 5, 2014 6:31 AM
Points: 291, Visits: 519
We have a DR drill every six months. All critical systems are tested every time. Others go through a rotation with the expectation that everything will be tested at least once every few years.

If you are short on money, consider using virtualized systems for your test. Remember, testing is not necessarily about the speed of the test system, but the ability to recover the data. In the event of a real disaster, the plan would include purchasing real hardware, but the recovery steps would be the same.

Our last test was a few days after the Irene and Lee dumped 8 inches of rain in two weeks. Our biggest concern: will the bridges be open so we can get to our test center.
Post #1187045
Posted Friday, October 7, 2011 6:54 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Wednesday, September 10, 2014 8:24 AM
Points: 1,141, Visits: 343
I work for a relatively small company that invests heavily in technology. Our critical systems have full hardware redundancy with real time replication to our DR site. We ARE in hurricane country and we do fail over our systems to our DR site at least once a year. We have other contingencies in place also.
Post #1187051
Posted Friday, October 7, 2011 7:09 AM
Right there with Babe

Right there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with Babe

Group: General Forum Members
Last Login: Tuesday, September 2, 2014 8:37 AM
Points: 751, Visits: 1,917
We do an offfsite DR test 2x per year.

In addition we are in a building with diesel generators and sufficient fuel to run for several weeks.


...

-- FORTRAN manual for Xerox Computers --
Post #1187061
Posted Friday, October 7, 2011 7:17 AM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Friday, September 12, 2014 10:44 AM
Points: 21,405, Visits: 9,617
jay holovacs (10/7/2011)
We do an offfsite DR test 2x per year.

In addition we are in a building with diesel generators and sufficient fuel to run for several weeks.



When you tried to run 24 / 7 on those generators, how many weeks did you last?


Do you check regularly that noone is "sniffing off" some of that fuel?


What happens if the fuel gets contaminated (I'd check here that everything is up to regulations, and highly unlikeky to be destroyed in the normal huge storms in your area).
Post #1187068
Posted Friday, October 7, 2011 7:25 AM
Right there with Babe

Right there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with BabeRight there with Babe

Group: General Forum Members
Last Login: Tuesday, September 2, 2014 8:37 AM
Points: 751, Visits: 1,917
Ninja's_RGR'us (10/7/2011)
jay holovacs (10/7/2011)
We do an offfsite DR test 2x per year.

In addition we are in a building with diesel generators and sufficient fuel to run for several weeks.



When you tried to run 24 / 7 on those generators, how many weeks did you last?


Do you check regularly that noone is "sniffing off" some of that fuel?


What happens if the fuel gets contaminated (I'd check here that everything is up to regulations, and highly unlikeky to be destroyed in the normal huge storms in your area).


Good questions. We are located in a manufacturing plant and the generators are maintained by our plant engineers. They are regularly tested (and certified for enviro regs), actually kind of an overkill in capacity for just a data center, but it is a nice luxury. Two Caterpillar turbocharged 6 cylinder engines and one 12 cylinder Cat. (One of our company's lines is electric distribution switch gear so we have a nice setup).

They share the same fuel supply as can be used in heating units (we also have natural gas) so the fuel level is rotated. It's one big killer size steel tank at the back of the plant.


...

-- FORTRAN manual for Xerox Computers --
Post #1187080
Posted Friday, October 7, 2011 7:32 AM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Friday, September 12, 2014 10:44 AM
Points: 21,405, Visits: 9,617
Ya my whole point is that untill and unless you try it, you just have no idea how much fuel "time" you really have.


I'd be assuming here that other system would draw power from that generator and that more might actually join in in a REAL dr situation.


It may sound like overkill but I'd ask to try and run the whole plant on a saturday strictly off those generators. Measure the fuel before & after and see if you forgot to plug anything that actually needs to run.


Also see how fast you can get delivery from the fuel company if you run out. Depending on the disaster, they might not be able to help quickly (if at all).

We had an icesotorm in Quebec a couple years ago and it took anywhere from 1 to 6 weeks to get electricity back (yes in winter in -20 conditions).


Fuel stations and convinience stores were all raided after day 1, not withstanding all the stores that had usefull equipement to sell.
Post #1187089
« Prev Topic | Next Topic »

Add to briefcase 12»»

Permissions Expand / Collapse