InstantForum.NET v2.9.0SQLServerCentralhttp://www.sqlservercentral.com/Forums/notifications@sqlservercentral.comWed, 19 Jun 2013 01:23:34 GMT20http://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspx[quote][b]Perry Whittle (2/18/2013)[/b][hr][quote][b]EdVassie (2/18/2013)[/b][hr]the best thing is to open a Support Case with Microsoft.[/quote]or hire a consultant to troubleshoot the system for you, which would likely be a lot cheaper than calling Microsoft ;-)[/quote]I solved it on my own. It's even cheaper! YEAH!This error perplexed me :[NODE] Node 2: New join with n1: stage: 'Authenticate Initial Connection' 00000f7c.000009ac::2013/02/18-12:06:33.886 ERR 000007fe:fe0f9e5d( ERROR_MOD_NOT_FOUND(126) ) 00000f7c.000009ac::2013/02/18-12:06:33.886 ERR 00000000:01ebf050( ERROR_MOD_NOT_FOUND(126) ) 00000f7c.000009ac::2013/02/18-12:06:33.886 ERR 00000000:003e0350( ERROR_MOD_NOT_FOUND(126) ) 00000f7c.000009ac::2013/02/18-12:06:33.886 ERR 00000000:ff53c050( ERROR_MOD_NOT_FOUND(126) ) 00000f7c.000009ac::2013/02/18-12:06:33.886 INFO [NODE] Node 2: New join with n1: stage: 'Authorize Initial Connection' status HrError(0x8009030c) reason: '[SV] Authorization failed'The Problem was that the RSA-Machinekey 4f692a7dc1b824e1f679f93fadd08a3b_6adaa04c-870a-4415-a11a-3cadf31e62e0 was unaccessible, allthough the Domain-User-Account running the Cluster Service was even owner. I added rights for the local admin (just for fun) and it worked! At this point I'll give up the search for a logical explanation, just stating, that you should never trust a microsoft error message. 99% of the microsoft error messages you could overwrite with : permission problem :D!Thank you very much for all your efforts and help!PS: If you run into permission problems, get familiar with [url=technet.microsoft.com/de-de/sysinternals/bb896645.aspx]process monitor[/url] :P!Wed, 20 Feb 2013 02:15:55 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspx[quote][b]EdVassie (2/18/2013)[/b][hr]the best thing is to open a Support Case with Microsoft.[/quote]or hire a consultant to troubleshoot the system for you, which would likely be a lot cheaper than calling Microsoft ;-)Mon, 18 Feb 2013 09:25:11 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxIf people on the Internet are not able to help within the timescale you want, then the best thing is to open a Support Case with Microsoft. SQL people know a bit about setting up clustering at an OS level, but Microsoft has experts in this area.Mon, 18 Feb 2013 03:47:14 GMTEdVassiehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxChanged the binding order of the networks...allthough validation did not fail about it, but nothing changed.Got no duplicate entry as user in AD...none of the internet solutions work...can anyone help me how to dig deeper?NOBODY ?!?Tue, 12 Feb 2013 17:19:03 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxwhere did you check the bindings?double check the TCPIP settings for each NIC and report backTue, 12 Feb 2013 04:37:32 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspx[quote][b]Perry Whittle (2/11/2013)[/b][hr][quote][b]SQL Pizza (2/11/2013)[/b][hr]Security Handshake failed to obtain SecurityContext for NetFT driver[/quote]You need to throw a dog a bone here my friend, what you've given is not very helpful. Can you provide details of the logs (obfuscate them first)?How many NICs does each server have?Have you checked the binding order?[/quote]Sorry for the tripple-post, but it's more open.Each of the server has 2 NICs. The binding order is okay. Now I got rid of the error I stated before, but it seems I can't get the servers to authenticate right for the heartbeat?!?Tue, 12 Feb 2013 03:38:52 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxcluster.log of the node to be added :0000045c.00000fd8::2013/02/12-10:25:00.688 INFO -----------------------------+ LOG BEGIN +-----------------------------0000045c.00000fd8::2013/02/12-10:25:00.688 INFO [CS] Starting clussvc as a service0000045c.00000fd8::2013/02/12-10:25:00.688 INFO [CS] cluster service logging level is 50000045c.00000d78::2013/02/12-10:25:00.703 INFO [CS] Creating cluster node <vector len='1'>0000045c.00000d78::2013/02/12-10:25:00.703 INFO <item>ClusSvc</item>0000045c.00000d78::2013/02/12-10:25:00.703 INFO </vector>0000045c.00000f70::2013/02/12-10:25:00.703 INFO [StartupConfig]: Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [StartupConfig]: Local node name: xyz6.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [StartupConfig]: Initializing NetFT adapter management information.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [NETFT] Initializing NetFT driver manager0000045c.00000f70::2013/02/12-10:25:00.703 INFO [CORE] Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [GEM] Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [MM] Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [MRR] Node 2: Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [Causal] Node 2: Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [EM] Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [GUM] Node 2: Initializing.0000045c.00000f70::2013/02/12-10:25:00.703 INFO [DM] Node 2: Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [CLFS] Initializing CLFS logger.0000045c.00000f70::2013/02/12-10:25:01.031 DBG [CLFS] Largest written record has size 131072 bytes0000045c.00000f70::2013/02/12-10:25:01.031 DBG [CLFS] Deleting old marshalling area.0000045c.00000f70::2013/02/12-10:25:01.031 DBG [CLFS] Marshaling area resized0000045c.00000f70::2013/02/12-10:25:01.031 INFO [TM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [JPM] Node 2: Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [VER]: Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [CCM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [FTI] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [ReM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [HM]: Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [NETFT] Starting NetFT eventing for FTI0000045c.00000f70::2013/02/12-10:25:01.031 DBG [NETFTAPI] received NsiInitialNotification0000045c.00000f70::2013/02/12-10:25:01.031 DBG [NETFTAPI] received NsiInitialNotification0000045c.00000f70::2013/02/12-10:25:01.031 INFO [NETFT] FTI NetFT event handler ready for events.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [IM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [NM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [NSM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [CM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [RCM] Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [QUORUM] Node 2: Initializing.0000045c.00000f70::2013/02/12-10:25:01.031 INFO [STARTUP] Node 2: startup config0000045c.00000f70::2013/02/12-10:25:01.031 INFO <StartupConfig localNodeId='2' testMode='false' newCluster='true'0000045c.00000f70::2013/02/12-10:25:01.031 INFO <ClusterName> xyzCluster </ClusterName>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <PaxosTag> 0:0:0 </PaxosTag>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <ConfiguredNodes> (1 2) </ConfiguredNodes>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <NodeWeights> (1 2) </NodeWeights>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <Nodes>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <Node name='xyz5' id='1'/>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <Node name='xyz6' id='2'/>0000045c.00000f70::2013/02/12-10:25:01.031 INFO </Nodes>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <LocalHiveFile> C:\Windows\Cluster\CLUSDB </LocalHiveFile>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <LocalHiveKey> Cluster </LocalHiveKey>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <ParametersKey> System\\CurrentControlSet\\Services\ClusSvc\Parameters </ParametersKey>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <Virtual IPv6> fe80::d56b:acaf:63e7:ac5%16:~3343~ </Virtual IPv6>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <Virtual IPv4> 169.254.22.211:~3343~ </Virtual IPv4>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <NoVersionCheck> false </NoVersionCheck>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <Cookie> 41e012b4-cd84-4218-a8e2-19415ea5ac42 </Cookie>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <ClusterGuid> 831d3f40-054d-4866-9785-5cf5a9ba51dc </ClusterGuid>0000045c.00000f70::2013/02/12-10:25:01.031 INFO <RetainNetFTConnSecurity> false </RetainNetFTConnSecurity>0000045c.00000f70::2013/02/12-10:25:01.031 INFO </StartupConfig>0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Node object creation completed.0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Starting cluster node0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Cluster Service started0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] The current time is 2013/02/12-11:25:01.0310000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Using virtual IPv6 Address fe80::d56b:acaf:63e7:ac5%16:~3343~0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Using virtual IPv4 Address 169.254.22.211:~3343~0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Max Licensed nodes is set 160000045c.00000d78::2013/02/12-10:25:01.031 INFO [NETFT] Disabling IP autoconfiguration on the NetFT adapter.0000045c.00000d78::2013/02/12-10:25:01.031 INFO [NETFT] Disabling DHCP on the NetFT adapter.0000045c.00000d78::2013/02/12-10:25:01.031 DBG [NETFT] Disabling DHCP on NetFT interface name ethernet_12.0000045c.00000d78::2013/02/12-10:25:01.031 INFO [CS] Starting DM0000045c.00000d78::2013/02/12-10:25:01.031 INFO [DM] Node 2: Reading quorum config0000045c.00000d78::2013/02/12-10:25:01.031 INFO [DM] Node 2: new cluster. generating new hive0000045c.00000d78::2013/02/12-10:25:01.031 DBG [DM] Unloading Hive, Key \Registry\Machine\Cluster, discardCurrentChanges true0000045c.0000050c::2013/02/12-10:25:01.031 INFO [CS] Disabling connection security.0000045c.00000d78::2013/02/12-10:25:01.031 INFO [DM] Key \Registry\Machine\Cluster does not appear to be loaded (status STATUS_OBJECT_NAME_NOT_FOUND(c0000034))0000045c.00000d78::2013/02/12-10:25:01.031 DBG [DM] Unloading Hive, Key \Registry\Machine\Cluster, discardCurrentChanges true0000045c.00000d78::2013/02/12-10:25:01.031 INFO [DM] Key \Registry\Machine\Cluster does not appear to be loaded (status STATUS_OBJECT_NAME_NOT_FOUND(c0000034))0000045c.00000d78::2013/02/12-10:25:01.031 DBG [DM] Creating Hive, Key Cluster, FilePath C:\Windows\Cluster\CLUSDB0000045c.00000938::2013/02/12-10:25:01.031 DBG [NETFTAPI] received NsiAddInstance for 169.254.22.2110000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding connection security permit filters for the NetFT adapter.0000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit Inbound Transport IPv40000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit Inbound Transport IPv60000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit Outbound Transport IPv40000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit Outbound Transport IPv60000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit ALE Accept IPv4 Universal0000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit ALE Accept IPv6 Universal0000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit ALE Accept IPv4 LIPS0000045c.0000050c::2013/02/12-10:25:01.047 INFO [NETFT] Adding FWPM filter Failover Cluster Permit ALE Accept IPv6 LIPS0000045c.0000050c::2013/02/12-10:25:01.047 DBG [CS] Done with connection security0000045c.00000d78::2013/02/12-10:25:01.312 DBG [DM] Saving temp Hive0000045c.00000d78::2013/02/12-10:25:01.343 DBG [DM] Unloading temp Hive0000045c.00000d78::2013/02/12-10:25:01.359 DBG [DM] Deleting temp Hive0000045c.00000d78::2013/02/12-10:25:01.359 INFO [DM] Loading Hive, Key Cluster, FilePath C:\Windows\Cluster\CLUSDB0000045c.00000d78::2013/02/12-10:25:01.686 INFO [DM] Paxos Tag Read from Hive: 0:0:00000045c.00000d78::2013/02/12-10:25:01.733 DBG [DM] Beginning transaction0000045c.00000d78::2013/02/12-10:25:01.733 INFO [QUORUM] unique node id for new node 1 is 00000000-0000-0000-0000-0000000000010000045c.00000d78::2013/02/12-10:25:01.733 INFO [QUORUM] unique node id for new node 2 is 00000000-0000-0000-0000-0000000000020000045c.00000d78::2013/02/12-10:25:01.733 DBG [CLFS] Deleting old marshalling area.0000045c.00000d78::2013/02/12-10:25:01.733 DBG [CLFS] Marshaling area resized0000045c.00000d78::2013/02/12-10:25:01.749 DBG [CLFS] Logger wrote 2830 bytes0000045c.00000d78::2013/02/12-10:25:01.749 DBG [DM] Committed transaction 0:0:10000045c.00000d78::2013/02/12-10:25:01.749 INFO [DM] Populating StartupConfig data from local hive.0000045c.00000d78::2013/02/12-10:25:01.749 INFO [DM] Node 2: startup configuration loaded:0000045c.00000d78::2013/02/12-10:25:01.749 INFO <StartupConfig localNodeId='2' testMode='false' newCluster='true'0000045c.00000d78::2013/02/12-10:25:01.749 INFO <ClusterName> xyzCluster </ClusterName>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <PaxosTag> 0:0:1 </PaxosTag>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <ConfiguredNodes> (1 2) </ConfiguredNodes>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <NodeWeights> (1 2) </NodeWeights>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <Nodes>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <Node name='xyz5' id='1'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <Node name='xyz6' id='2'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO </Nodes>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <LocalHiveFile> C:\Windows\Cluster\CLUSDB </LocalHiveFile>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <LocalHiveKey> Cluster </LocalHiveKey>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <ParametersKey> System\\CurrentControlSet\\Services\ClusSvc\Parameters </ParametersKey>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <Virtual IPv6> fe80::d56b:acaf:63e7:ac5%16:~3343~ </Virtual IPv6>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <Virtual IPv4> 169.254.22.211:~3343~ </Virtual IPv4>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <NoVersionCheck> false </NoVersionCheck>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <Cookie> 41e012b4-cd84-4218-a8e2-19415ea5ac42 </Cookie>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <ClusterGuid> 831d3f40-054d-4866-9785-5cf5a9ba51dc </ClusterGuid>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <RetainNetFTConnSecurity> false </RetainNetFTConnSecurity>0000045c.00000d78::2013/02/12-10:25:01.749 INFO </StartupConfig>0000045c.00000d78::2013/02/12-10:25:01.749 INFO [CS] Starting MM0000045c.00000d78::2013/02/12-10:25:01.749 INFO [MM] Starting.0000045c.00000d78::2013/02/12-10:25:01.749 INFO [GEM] Node 2: Resume (newView = 002(2), previousView = 000())0000045c.00000d78::2013/02/12-10:25:01.749 DBG [GEM] Node 2: SendNextMessage0000045c.00000d78::2013/02/12-10:25:01.749 DBG [GEM] Node 2: No more messages in queue0000045c.00000d78::2013/02/12-10:25:01.749 INFO [StartupConfig] Writing new StartupConfig entries to ObjectManager0000045c.00000d78::2013/02/12-10:25:01.749 DBG [StartupConfig] Writing node xyz5 (id = 1) to ObjectManager0000045c.00000d78::2013/02/12-10:25:01.749 INFO [QUORUM] unique node id for new node 1 is 00000000-0000-0000-0000-0000000000010000045c.00000d78::2013/02/12-10:25:01.749 INFO [MQ-xyz5] Starting0000045c.00000d78::2013/02/12-10:25:01.749 INFO [MQ-xyz5] Clearing 0 unsent and 0 unacknowledged messages.0000045c.00000d78::2013/02/12-10:25:01.749 INFO <ObjectManager>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <ROOT id='.root' name='.root'>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <GEMA id='GemAgent' name='GemAgent2'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <MRRA id='MrrAgent2' name='MrrAgent2'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <CAUS id='CausalAgent' name='CausalAgent'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <EVTM id='EventManager' name='EventManager'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <GUMA id='GumAgent2' name='GumAgent2'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <JPMA id='JpmAgent' name='JpmAgent'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <IMSC id='[IM-2] ' name='[IM-2] '/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <RPCS id='[RPC-2] ' name='[RPC-2] '/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <RCMA id='RcmAgent' name='RcmAgent'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <QRMA id='QuorumAgent2' name='QuorumAgent2'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <DCMA id='DcmAgent' name='DcmAgent'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <VSSR id='Cluster VSS Writer' name='Cluster VSS Writer'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <CLUS id='xyzCluster' name='xyzCluster'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <DEAD id='.Dead' name='.Dead'>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <NODE id='1' name='xyz5'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO </DEAD>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <LIVE id='.Live' name='.Live'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <JOIN id='.Joiners' name='.Joiners'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO <MBRA id='MembershipAgent' name='MembershipAgent'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO </ROOT>0000045c.00000d78::2013/02/12-10:25:01.749 INFO </ObjectManager>0000045c.00000d78::2013/02/12-10:25:01.749 INFO [MM] Node 2: got a network stream to 2. Creating new NodeObject0000045c.00000d78::2013/02/12-10:25:01.749 INFO [QUORUM] unique node id for new node 2 is 00000000-0000-0000-0000-0000000000020000045c.00000d78::2013/02/12-10:25:01.749 INFO [MQ-xyz6] Starting0000045c.00000d78::2013/02/12-10:25:01.749 INFO [MQ-xyz6] Clearing 0 unsent and 0 unacknowledged messages.0000045c.00000d78::2013/02/12-10:25:01.749 INFO [NODE] Node 2: n2 node object adding stream0000045c.00000d78::2013/02/12-10:25:01.749 DBG [NODE] Node 2: n2 node object got a channel0000045c.00000d78::2013/02/12-10:25:01.749 INFO [NODE] Node 2: Highest version with n2 = Major 0 Minor 0 Upgrade 0 ClusterVersion 0x00000000, lowest = Major 0 Minor 0 Upgrade 0 ClusterVersion 0x000000000000045c.00000d78::2013/02/12-10:25:01.749 INFO [NODE] Node 2: Done processing new stream to n2.0000045c.00000d78::2013/02/12-10:25:01.749 INFO [CS] Starting QM0000045c.00000d78::2013/02/12-10:25:01.749 DBG [NETFT] Halt Notification set0000045c.00000d78::2013/02/12-10:25:01.749 INFO [CS] Starting TM0000045c.00000d78::2013/02/12-10:25:01.749 INFO [NETFT] Starting NetFT eventing for TM0000045c.00000d78::2013/02/12-10:25:01.749 INFO [NETFT] TM NetFT event handler ready for events.0000045c.00000d78::2013/02/12-10:25:01.749 INFO [CS] Starting IM0000045c.00000d78::2013/02/12-10:25:01.749 INFO [NETFT] Starting NetFT eventing for IM0000045c.00000d78::2013/02/12-10:25:01.749 INFO [NETFT] IM NetFT event handler ready for events.0000045c.00000d78::2013/02/12-10:25:01.749 INFO [CS] Starting NM0000045c.00000d78::2013/02/12-10:25:01.749 INFO [CS] Starting api server0000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] Api Onlined0000045c.000001d8::2013/02/12-10:25:01.749 INFO [PULLER xyz6] Just about to start reading from <LoopbackStream name='xyz6'/>0000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] UseProtseq ncalrpc => 00000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] UseProtseq ncadg_ip_tcp => 00000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] InqBindings => 00000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] RpcEpRegister => 00000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] RpcServerRegister => 00000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] Initializing0000045c.00000d78::2013/02/12-10:25:01.749 INFO [API] Adding Mgmt API SPNs to node's Computer Object0000045c.00000d78::2013/02/12-10:25:01.764 INFO [API] Successfully added Mgmt API SPNs to node's Computer Object0000045c.00000d78::2013/02/12-10:25:01.764 ERR [API] DmQueryString failed to retrieve the security descriptor status 2, default security descriptor will be used for authorizing client connections0000045c.00000d78::2013/02/12-10:25:01.764 INFO [API] Successfully built the default cluster SD.0000045c.00000d78::2013/02/12-10:25:01.764 INFO [CS] Bringing API Online0000045c.00000d78::2013/02/12-10:25:01.764 INFO [CORE] Node 2: New View is <ViewChanged joiners=(2) downers=() newView=002(2) oldView=000() joiner=true form=true/> (Start Dispatch)0000045c.00000d78::2013/02/12-10:25:01.764 INFO [MRR] Node 2: Process view 002(2)0000045c.00000d78::2013/02/12-10:25:01.764 INFO [RCM] rcm::RcmAgent::ProcessView: Ignoring view change (won't attempt to move orphaned groups), since I'm not in RCM view yet.0000045c.00000d78::2013/02/12-10:25:01.764 DBG [GEM] Node 2: message added to send queue0000045c.00000d78::2013/02/12-10:25:01.764 DBG [GEM] Node 2: SendNextMessage0000045c.00000d78::2013/02/12-10:25:01.764 DBG [GEM] Node 2: delivering message 2:10000045c.00000d78::2013/02/12-10:25:01.764 INFO [CORE] EmitReadyForState for node 20000045c.00000d78::2013/02/12-10:25:01.764 INFO [CORE] Issuing NeedStateViewChanged((2))0000045c.00000d78::2013/02/12-10:25:01.764 DBG [GEM] Node 2: ProcessAck from node 2 (already acked ())0000045c.00000d78::2013/02/12-10:25:01.764 DBG [GEM] Node 2: SendNextMessage0000045c.00000d78::2013/02/12-10:25:01.764 DBG [GEM] Node 2: No more messages in queue0000045c.00000d78::2013/02/12-10:25:01.764 DBG [NODE] Node 2: eating message sent to the dead node 10000045c.00000d78::2013/02/12-10:25:01.764 INFO [QUORUM] Node 2: I am the form/join coordinator (offline and lowest number node). Launching worker to request quorum config from other nodes0000045c.00000d78::2013/02/12-10:25:01.764 DBG [MRR] Node 2: insert request record for RID 10000045c.00000d78::2013/02/12-10:25:01.764 DBG [MRR] SendRequest(<message action='qrm/request-info' GemId='0' target='QRMA' sender='-1'mrr='1'/>)0000045c.00000d78::2013/02/12-10:25:01.764 DBG [CORE] Node 2: sending qrm/request-info to QRMA at xyz60000045c.00000d78::2013/02/12-10:25:01.764 INFO [CORE] Node 2: New View is <ViewChanged joiners=(2) downers=() newView=002(2) oldView=000() joiner=true form=true/> (Stop Dispatch)0000045c.00000d78::2013/02/12-10:25:01.764 INFO [CS] Starting HM Server0000045c.00000d78::2013/02/12-10:25:01.764 INFO [NODE] Node 2: New join with n1: stage: 'Listen for Connection'0000045c.00000d78::2013/02/12-10:25:01.764 INFO [CS] Starting JPM (attempting connections to other cluster nodes)0000045c.00000d78::2013/02/12-10:25:01.764 DBG [JPM] Node 2: Dead node mentioned xyz50000045c.00000d78::2013/02/12-10:25:01.764 DBG [JPM] Node 2: Dead node mentioned xyz60000045c.00000d78::2013/02/12-10:25:01.764 INFO [CS] Subscribing for VSS requests0000045c.00000d78::2013/02/12-10:25:01.764 INFO [VSS] Initializing Cluster VSS Writer at the command of the VSS framework.0000045c.00000a90::2013/02/12-10:25:01.764 DBG [NODE] Node 2: just about to send a message of size 109 to 20000045c.00000a90::2013/02/12-10:25:01.764 DBG [NODE] Node 2: message to node 2 sent0000045c.000001d8::2013/02/12-10:25:01.764 INFO [QUORUM] Node 2: received request for quorum info. Replying with quorum state <QuorumConfig tag='0:0:1' set='(1 2)' weights='(1 2)'/>0000045c.000001d8::2013/02/12-10:25:01.764 DBG [CORE] Node 2: sending mrr/reply to MRRA at xyz60000045c.00000a90::2013/02/12-10:25:01.764 DBG [NODE] Node 2: just about to send a message of size 0 to 20000045c.00000a90::2013/02/12-10:25:01.764 DBG [NODE] Node 2: message to node 2 sent0000045c.00000a90::2013/02/12-10:25:01.764 DBG [NODE] Node 2: just about to send a message of size 278 to 20000045c.00000a90::2013/02/12-10:25:01.764 DBG [NODE] Node 2: message to node 2 sent0000045c.000001d8::2013/02/12-10:25:01.764 DBG [MRR] Node 2: processing reply <message action='mrr/reply' GemId='0' target='MRRA' sender='2'mrr='1'/>0000045c.000001d8::2013/02/12-10:25:01.764 DBG [MRR] Node 2: Request RID 1 is completed0000045c.00000938::2013/02/12-10:25:01.764 INFO [QUORUM] Node 2: setting next best epoch to 00000045c.00000938::2013/02/12-10:25:01.764 DBG [QC] Calculating quorum: Configured nodes count = 2, Node weights count = 2, Quorum witness configured = false, Intersection count = 10000045c.00000938::2013/02/12-10:25:01.764 INFO [QUORUM] Node 2: Coordinator: no quorum yet. do nothing0000045c.00000ef0::2013/02/12-10:25:01.764 DBG [JPM] Node 2: Building contact data for node xyz5.0000045c.00000ef0::2013/02/12-10:25:01.764 INFO [JPM] Node 2: Scheduling DNS query for node name xyz50000045c.00000ef0::2013/02/12-10:25:01.764 DBG [JPM] Node 2: no valid contact endpoints yet for node xyz5.0000045c.00000ef0::2013/02/12-10:25:01.780 INFO [JPM] Node 2: Found possible contact address 100.100.100.102:~0~ for node xyz5 via DNS.0000045c.00000d78::2013/02/12-10:25:01.780 INFO [CS] Starting the Watchdog Monitor0000045c.00000d78::2013/02/12-10:25:01.780 INFO [WM] Monitoring the kernel-mode watchdog.0000045c.00000d78::2013/02/12-10:25:01.780 INFO [CS] Reporting to SCM that cluster service has started.0000045c.00000c6c::2013/02/12-10:25:02.778 DBG [JPM] Node 2: contacts size for node xyz5 is 1, current index 00000045c.00000c6c::2013/02/12-10:25:02.778 DBG [JPM] Node 2: Trying to connect to node xyz5 (IP: 100.100.100.102:~0~)0000045c.00000c6c::2013/02/12-10:25:02.778 DBG [HM] Trying to connect to xyz5 at 100.100.100.102:~3343~0000045c.00000c6c::2013/02/12-10:25:02.778 INFO [CONNECT] 100.100.100.102:~3343~: Established connection to remote endpoint 100.100.100.102:~3343~.0000045c.00000c6c::2013/02/12-10:25:02.778 INFO [NODE] Node 2: New join with n1: stage: 'Attempt Initial Connection'0000045c.00000c6c::2013/02/12-10:25:02.778 INFO [SV] Securing route from (100.100.100.101:~50282~) to remote xyz5 (100.100.100.102:~3343~).0000045c.00000c6c::2013/02/12-10:25:02.778 INFO [SV] Got a new outgoing stream to xyz5 at 100.100.100.102:~3343~0000045c.00000c6c::2013/02/12-10:25:02.778 DBG [SM] Joiner: Initialized with SPN = xyz5, Package = Kerberos, RequiredCtxAttrib = 83990, HandShakeTimeout = 300000000045c.00000958::2013/02/12-10:25:02.778 DBG [SM] Handling auth handshake posted by thread id 31800000045c.00000958::2013/02/12-10:25:02.778 DBG [SM] Joiner: ISC returned status = 590610 output Blob size 15530000045c.00000958::2013/02/12-10:25:02.778 DBG [SM] Joiner: Received SSPI blob from the Sponsor of size 1550000045c.00000958::2013/02/12-10:25:02.778 DBG [SM] Joiner: ISC returned status = 0 output Blob size 00000045c.00000c6c::2013/02/12-10:25:02.778 INFO [NODE] Node 2: New join with n1: stage: 'Authenticate Initial Connection'0000045c.00000c6c::2013/02/12-10:25:02.809 ERR 000007fe:fdd69e5d( ERROR_MOD_NOT_FOUND(126) )0000045c.00000c6c::2013/02/12-10:25:02.809 ERR 00000000:013deec0( ERROR_MOD_NOT_FOUND(126) )0000045c.00000c6c::2013/02/12-10:25:02.809 ERR 00000000:0020c660( ERROR_MOD_NOT_FOUND(126) )0000045c.00000c6c::2013/02/12-10:25:02.809 ERR 00000000:ff5fc050( ERROR_MOD_NOT_FOUND(126) )0000045c.00000c6c::2013/02/12-10:25:02.809 INFO [NODE] Node 2: New join with n1: stage: 'Authorize Initial Connection' status HrError(0x8009030c) reason: '[SV] Authorization failed'0000045c.00000c6c::2013/02/12-10:25:02.809 DBG [CHANNEL 100.100.100.102:~3343~] Close().0000045c.00000c6c::2013/02/12-10:25:02.809 WARN cxl::ConnectWorker::operator (): HrError(0x8009030c)' because of '[SV] Authentication or Authorization Failed'0000045c.00000d28::2013/02/12-10:26:03.774 DBG [JPM] Node 2: contacts size for node xyz5 is 1, current index 00000045c.00000d28::2013/02/12-10:26:03.774 DBG [JPM] Node 2: Trying to connect to node xyz5 (IP: 100.100.100.102:~0~)0000045c.00000d28::2013/02/12-10:26:03.774 DBG [HM] Trying to connect to xyz5 at 100.100.100.102:~3343~0000045c.00000d28::2013/02/12-10:26:03.774 INFO [CONNECT] 100.100.100.102:~3343~: Established connection to remote endpoint 100.100.100.102:~3343~.0000045c.00000d28::2013/02/12-10:26:03.774 INFO [SV] Securing route from (100.100.100.101:~50292~) to remote xyz5 (100.100.100.102:~3343~).0000045c.00000d28::2013/02/12-10:26:03.774 INFO [SV] Got a new outgoing stream to xyz5 at 100.100.100.102:~3343~0000045c.00000d28::2013/02/12-10:26:03.774 DBG [SM] Joiner: Initialized with SPN = xyz5, Package = Kerberos, RequiredCtxAttrib = 83990, HandShakeTimeout = 300000000045c.00000958::2013/02/12-10:26:03.774 DBG [SM] Handling auth handshake posted by thread id 33680000045c.00000958::2013/02/12-10:26:03.774 DBG [SM] Joiner: ISC returned status = 590610 output Blob size 15530000045c.00000958::2013/02/12-10:26:03.774 DBG [SM] Joiner: Received SSPI blob from the Sponsor of size 1550000045c.00000958::2013/02/12-10:26:03.774 DBG [SM] Joiner: ISC returned status = 0 output Blob size 00000045c.00000d28::2013/02/12-10:26:03.805 ERR 000007fe:fdd69e5d( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:26:03.805 ERR 00000000:0192ee50( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:26:03.805 ERR 00000000:001f5110( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:26:03.805 ERR 00000000:ff5fc050( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:26:03.805 INFO [NODE] Node 2: New join with n1: stage: 'Authorize Initial Connection' status HrError(0x8009030c) reason: '[SV] Authorization failed'0000045c.00000d28::2013/02/12-10:26:03.805 DBG [CHANNEL 100.100.100.102:~3343~] Close().0000045c.00000d28::2013/02/12-10:26:03.805 WARN cxl::ConnectWorker::operator (): HrError(0x8009030c)' because of '[SV] Authentication or Authorization Failed'0000045c.00000d28::2013/02/12-10:27:04.770 DBG [JPM] Node 2: contacts size for node xyz5 is 1, current index 00000045c.00000d28::2013/02/12-10:27:04.770 DBG [JPM] Node 2: Trying to connect to node xyz5 (IP: 100.100.100.102:~0~)0000045c.00000d28::2013/02/12-10:27:04.770 DBG [HM] Trying to connect to xyz5 at 100.100.100.102:~3343~0000045c.00000d28::2013/02/12-10:27:04.770 INFO [CONNECT] 100.100.100.102:~3343~: Established connection to remote endpoint 100.100.100.102:~3343~.0000045c.00000d28::2013/02/12-10:27:04.770 INFO [SV] Securing route from (100.100.100.101:~50298~) to remote xyz5 (100.100.100.102:~3343~).0000045c.00000d28::2013/02/12-10:27:04.770 INFO [SV] Got a new outgoing stream to xyz5 at 100.100.100.102:~3343~0000045c.00000d28::2013/02/12-10:27:04.770 DBG [SM] Joiner: Initialized with SPN = xyz5, Package = Kerberos, RequiredCtxAttrib = 83990, HandShakeTimeout = 300000000045c.00000958::2013/02/12-10:27:04.770 DBG [SM] Handling auth handshake posted by thread id 33680000045c.00000958::2013/02/12-10:27:04.770 DBG [SM] Joiner: ISC returned status = 590610 output Blob size 15530000045c.00000958::2013/02/12-10:27:04.770 DBG [SM] Joiner: Received SSPI blob from the Sponsor of size 1540000045c.00000958::2013/02/12-10:27:04.770 DBG [SM] Joiner: ISC returned status = 0 output Blob size 00000045c.00000d28::2013/02/12-10:27:04.801 ERR 000007fe:fdd69e5d( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:27:04.801 ERR 00000000:0192ee50( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:27:04.801 ERR 00000000:001f5110( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:27:04.801 ERR 00000000:ff5fc050( ERROR_MOD_NOT_FOUND(126) )0000045c.00000d28::2013/02/12-10:27:04.801 INFO [NODE] Node 2: New join with n1: stage: 'Authorize Initial Connection' status HrError(0x8009030c) reason: '[SV] Authorization failed'0000045c.00000d28::2013/02/12-10:27:04.801 DBG [CHANNEL 100.100.100.102:~3343~] Close().0000045c.00000d28::2013/02/12-10:27:04.801 WARN cxl::ConnectWorker::operator (): HrError(0x8009030c)' because of '[SV] Authentication or Authorization Failed'Tue, 12 Feb 2013 03:20:36 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxAdd Cluster Nodes-ReportNode: xyz.mydomain.local Started 12.02.2013 10:43:39 Completed 12.02.2013 10:49:58 Adding xyz.mydomain.local to the cluster.Validating cluster state on node xyz.Getting current node membership of cluster xyzCluster.Adding node xyz to Cluster configuration data.Validating installation of the Network FT Driver on node xyz.Validating installation of the Cluster Disk Driver on node xyz.Configuring Cluster Service on node xyz.Waiting for notification that Cluster service on node xyz.mydomain.local has started.Waiting for notification that node xyz is a fully functional member of the cluster.Unable to successfully cleanup.The server 'xyz.mydomain.local' could not be added to the cluster.An error occurred while adding node 'xyz.mydomain.local' to cluster 'xyzCluster'.This operation returned because the timeout period expTue, 12 Feb 2013 03:18:39 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspx[quote][b]SQL Pizza (2/11/2013)[/b][hr]Security Handshake failed to obtain SecurityContext for NetFT driver[/quote]You need to throw a dog a bone here my friend, what you've given is not very helpful. Can you provide details of the logs (obfuscate them first)?How many NICs does each server have?Have you checked the binding order?Mon, 11 Feb 2013 08:25:17 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxSecurity Handshake failed to obtain SecurityContext for NetFT driverMon, 11 Feb 2013 07:37:35 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxwhich problem?Mon, 11 Feb 2013 07:27:18 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxAll checked an stucked by the problem I posted since 1 week :(Mon, 11 Feb 2013 07:10:48 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxCheck network connectivity between the nodes and the domain.Have you checked the windows event logs and also the cluster events for further info.Mon, 11 Feb 2013 05:53:13 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxYes, members of the domain and physical machines.Mon, 11 Feb 2013 05:45:32 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxhave your server admins check that each node is well connected to the domain for starters.Are these physical or virtual machines?Mon, 11 Feb 2013 05:43:08 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxThe cluster generation fails at the OS Level. We've got 2 servers with Windows Server 2008 R2 Enterprise 64Bit. When I want to create the cluster in failover cluster manager, it comes until the point "forming cluster". Here it hangs an comes after 2 minutes up with a timeout. The prevalidation is 100% free of errors. If I take a look at the clusterlog, I see this "Security Handshake failed to obtain SecurityContext for NetFT driver". Node 2 forcibly closes the connection so the cluster creation fails.Tell me whatever further details you need!Mon, 11 Feb 2013 05:27:46 GMTSQL Pizzahttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxCan you supply a little more detail about the environment and exactly what steps you are at when you get the failure?Mon, 11 Feb 2013 05:09:24 GMTPerry Whittlehttp://www.sqlservercentral.com/Forums/Topic1418271-1549-1.aspxHi.I want to create a failover cluster and always get the following error while creating the windows server cluster : Security Handshake failed to obtain SecurityContext for NetFT driver. I almost tried everything I found to this topic in the internet. Could anybody help me with this issue. It's very critical, because it's a productive environment.Sorry...the title of the topic shall be changed to : Cluster Installation Time Out IssueMon, 11 Feb 2013 02:56:11 GMTSQL Pizza