Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

One Node in Cluster has completely failed and we need to rebuild the cluster Expand / Collapse
Author
Message
Posted Tuesday, January 8, 2013 8:17 AM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Tuesday, March 18, 2014 12:13 PM
Points: 195, Visits: 1,080
One node in our cluster had a hardware failure and comepletely down and need to rebuild. I am asking for advices/suggestions to get back the node and the cluster working.

1.the OS is Windows 2008 R2 Enterprises
2.SQL version is SQL 2008


They are asking if we want to
a) completely rebuild the server ---if we go down this path, what do i need to do to get the SQL cluster working
b) restore the server from an earlier backup--Will this restore mess up the SQL Cluster settings or functions?


Please advise...thank you in advance
Post #1404272
Posted Tuesday, January 8, 2013 9:18 AM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Tuesday, March 18, 2014 12:13 PM
Points: 195, Visits: 1,080
Found this KB article from Microsoft,

http://msdn.microsoft.com/en-us/library/ms181075(v=sql.100).aspx

anyone having any issues by following the steps in there?
Post #1404323
Posted Tuesday, January 8, 2013 10:17 AM
Grasshopper

GrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopper

Group: General Forum Members
Last Login: Friday, October 4, 2013 8:00 AM
Points: 15, Visits: 130
Just to add a check point

Once the cluster node is built and added to the MSCS cluster. Please validate the cluster setup.
After installing SQL Server, Test the cluster by performing failover.
Post #1404364
Posted Wednesday, January 9, 2013 1:45 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 4:09 PM
Points: 6,163, Visits: 13,306
DBA in Unit 7 (1/8/2013)
One node in our cluster had a hardware failure and comepletely down and need to rebuild. I am asking for advices/suggestions to get back the node and the cluster working.

1.the OS is Windows 2008 R2 Enterprises
2.SQL version is SQL 2008


They are asking if we want to
a) completely rebuild the server ---if we go down this path, what do i need to do to get the SQL cluster working
b) restore the server from an earlier backup--Will this restore mess up the SQL Cluster settings or functions?


Please advise...thank you in advance

How recent is the system state backup of the failed node?

If you dont have a recent backup i would evict the failed node and perform a clean OS install to the new hardware. Add the node to the cluster and then re install any clustered applications.


-----------------------------------------------------------------------------------------------------------

"Ya can't make an omelette without breaking just a few eggs"
Post #1404600
Posted Wednesday, January 9, 2013 7:19 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Yesterday @ 7:33 AM
Points: 1,361, Visits: 15,264
Perry Whittle (1/9/2013)
DBA in Unit 7 (1/8/2013)
One node in our cluster had a hardware failure and comepletely down and need to rebuild. I am asking for advices/suggestions to get back the node and the cluster working.

1.the OS is Windows 2008 R2 Enterprises
2.SQL version is SQL 2008


They are asking if we want to
a) completely rebuild the server ---if we go down this path, what do i need to do to get the SQL cluster working
b) restore the server from an earlier backup--Will this restore mess up the SQL Cluster settings or functions?


Please advise...thank you in advance

How recent is the system state backup of the failed node?

If you dont have a recent backup i would evict the failed node and perform a clean OS install to the new hardware. Add the node to the cluster and then re install any clustered applications.


+1 from me. Its cleaner in my opinion.
Post #1404772
Posted Monday, January 28, 2013 1:48 PM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Tuesday, March 18, 2014 12:13 PM
Points: 195, Visits: 1,080
Thanks for all the responses above.
and now that the cluster is back to shape and i would like to report back what was done.

1. Yes, the failed node was evicted from the cluster and did a Clean OS install on the new hardware
2. the Windows Cluster was reestablished and handed us ( our host service provider handles our OS and below)
--one thing I would like to add here though, make sure your Surviving node( the one having the SQL running) will NOT fail over to the new built NODE.
3. once I got the Windows cluster, i did run a Cluster validation report and it went well.
4. The I installed the SQL Server 2008 ( by choosing the adding new node),I had to run the installation by running from command line though. it went smoothly. :)
5. installed SP3
6. Installed other stuff (Oracle client for the linked server, and some other backup/monitoring utilities)

failover and fail back, things work as expected.


Yeah, we are being lucky, i think, this incident didn't create much drama. thanks for all the above inputs again.

Post #1412639
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse