Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase ««123»»

Qourum disk running low on disk space Expand / Collapse
Author
Message
Posted Monday, October 7, 2013 4:25 PM


SSC-Forever

SSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-Forever

Group: General Forum Members
Last Login: Yesterday @ 12:11 PM
Points: 42,470, Visits: 35,541
Gerard Silveira (10/7/2013)
@Dhananjay,
From Windows explorer the only directories I see are the MSCS and MSDTC, there is nothing else that I can see that could be steadily eating up the disk space on the quorum drive.


Do you have explorer set to show hidden and system files?

What are the sizes of those two directories?



Gail Shaw
Microsoft Certified Master: SQL Server 2008, MVP
SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

We walk in the dark places no others will enter
We stand on the bridge and no one may pass

Post #1502409
Posted Monday, October 7, 2013 4:31 PM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: General Forum Members
Last Login: Yesterday @ 8:06 PM
Points: 36,786, Visits: 31,243
GilaMonster (10/7/2013)
Jeff Moden (10/7/2013)
GilaMonster (10/7/2013)
Jeff Moden (10/5/2013)
I have a similar problem that turns out to be some rather inefficient code that truncates several very large tables and reloads ALL of the data from an AS 400 every bloody night. Folks are in the process of repairing the code for performance and I'm in the process of moving the tables to a dedicated database in the SIMPLE recovery mode and to a separate set of disks not on the SAN.


Why would that affect the cluster's quorum drive?


Because everything that changes int these tables ends up going to the quorum drive.


If it does someone has badly configured that cluster. There should be nothing from SQL Server on the quorum drive. I don't even know if the quorum drive can be marked as a dependency of SQL, it should be off limits to everything but the cluster management itself.

All that should be on the quorum drive are logs and a few files put down by the cluster installation, it should never be used for anything else.


Sorry... I hit post before I finished. I didn't have anything to do with this setup so I don't have a sufficient understanding of the details but our NetOps guys are apparently using the quorum drive to transfer data to our warm DR site. If the pipe between here and the DR site can't keep up, then the data on the quorum drive just gets larger and larger. From what I've been told, it's not actually SQL Server that's feeding the quorum drive. The quorum drive is only responding to what is changing on the SAN drives. What's changing on the SAN drives is an absolute shedload of data during the nightly runs. There was some tipping point where if it got too far behind, it would go into a rather dedicated transfer mode and that just crushed the server when it happened. I use past tense because they supposedly fixed the problem but I'm not sure what they did to fix it other than getting a better pipe between us and the DR site.



--Jeff Moden
"RBAR is pronounced "ree-bar" and is a "Modenism" for "Row-By-Agonizing-Row".

First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column."

(play on words) "Just because you CAN do something in T-SQL, doesn't mean you SHOULDN'T." --22 Aug 2013

Helpful Links:
How to post code problems
How to post performance problems
Post #1502410
Posted Monday, October 7, 2013 4:46 PM


SSC-Forever

SSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-Forever

Group: General Forum Members
Last Login: Yesterday @ 12:11 PM
Points: 42,470, Visits: 35,541
Jeff Moden (10/7/2013)
our NetOps guys are apparently using the quorum drive to transfer data to our warm DR site.


Oh my, that is horrid cluster design. Nothing but nothing should ever go onto the quorum.

The quorum drive is only responding to what is changing on the SAN drives.


Shouldn't be doing that. There should be no impact on the quorum from the other drives. It's not a staging drive for other cluster drives, all it should be is there to 'arbitrate' ownership of the cluster



Gail Shaw
Microsoft Certified Master: SQL Server 2008, MVP
SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

We walk in the dark places no others will enter
We stand on the bridge and no one may pass

Post #1502412
Posted Monday, October 7, 2013 4:56 PM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Tuesday, May 6, 2014 5:45 AM
Points: 127, Visits: 307
Completely agree with GilaMonster.. DB has nothing to do with Quorum Drive... Not dependent too... Nothing exists on Quorum disk except few files. You need to check all hidden files and directory. If you can paste that here (snapshot), i will able to tell you the dependent files for cluster. Rest all you can remove..
Post #1502414
Posted Monday, October 7, 2013 6:16 PM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Yesterday @ 12:45 PM
Points: 73, Visits: 183
Here is the directory listing
The Quorum drive has 1GB space assigned to it

Volume in drive Q is SQLRDM02-Quorum00
Volume Serial Number is

Directory of Q:\

10/07/2013 08:11 PM <DIR> MSCS
06/23/2009 03:50 PM <DIR> MSDtc
09/09/2012 09:06 AM <DIR> RECYCLER
05/31/2012 09:19 AM <DIR> System Volume Information
0 File(s) 0 bytes

Directory of Q:\MSCS

10/07/2013 08:11 PM <DIR> .
10/07/2013 08:11 PM <DIR> ..
07/07/2009 12:48 PM <DIR> 1b82aa9a-0428-400a-ba2f-98db2cdfe3a9
07/07/2009 07:30 PM <DIR> 36e30fb5-1862-490e-895d-c705e95661be
07/07/2009 12:38 PM <DIR> 54f37c4e-2a4c-4514-bd5f-045513b78133
07/07/2009 07:52 PM <DIR> 67bd7082-e6e2-4d39-8540-1c9597b68743
09/10/2010 10:09 AM 57,344 chk2E3F.tmp
10/07/2013 07:34 PM 57,344 chk5BE0.tmp
07/07/2009 07:12 PM <DIR> f883705e-1b80-4f8a-b925-74bf622b7567
06/23/2009 03:50 PM <DIR> f9670a20-d05a-40df-a6f2-f1e6e21022da
10/07/2013 08:11 PM <DIR> MSDtc
10/07/2013 07:34 PM 32,768 quolog.log
3 File(s) 147,456 bytes

Directory of Q:\MSCS\1b82aa9a-0428-400a-ba2f-98db2cdfe3a9

07/07/2009 12:48 PM <DIR> .
07/07/2009 12:48 PM <DIR> ..
07/07/2009 12:48 PM 764 00000001.CPR
1 File(s) 764 bytes

Directory of Q:\MSCS\36e30fb5-1862-490e-895d-c705e95661be

07/07/2009 07:30 PM <DIR> .
07/07/2009 07:30 PM <DIR> ..
07/07/2009 07:30 PM 764 00000001.CPR
07/07/2009 07:30 PM 8,192 00000001.CPT
10/07/2013 08:11 PM 12,288 00000002.CPT
07/07/2009 07:30 PM 8,192 00000003.CPT
07/07/2009 07:30 PM 8,192 00000004.CPT
07/07/2009 07:30 PM 8,192 00000005.CPT
07/07/2009 07:30 PM 8,192 00000006.CPT
09/25/2013 09:15 AM 12,288 00000007.CPT
8 File(s) 66,300 bytes

Directory of Q:\MSCS\54f37c4e-2a4c-4514-bd5f-045513b78133

07/07/2009 12:38 PM <DIR> .
07/07/2009 12:38 PM <DIR> ..
07/07/2009 12:38 PM 764 00000001.CPR
1 File(s) 764 bytes

Directory of Q:\MSCS\67bd7082-e6e2-4d39-8540-1c9597b68743

07/07/2009 07:52 PM <DIR> .
07/07/2009 07:52 PM <DIR> ..
07/07/2009 07:51 PM 764 00000001.CPR
07/07/2009 07:51 PM 8,192 00000001.CPT
10/07/2013 08:12 PM 12,288 00000002.CPT
07/07/2009 07:51 PM 8,192 00000003.CPT
07/07/2009 07:51 PM 8,192 00000004.CPT
07/07/2009 07:51 PM 8,192 00000005.CPT
07/07/2009 07:51 PM 8,192 00000006.CPT
09/17/2012 01:37 PM 12,288 00000007.CPT
8 File(s) 66,300 bytes

Directory of Q:\MSCS\f883705e-1b80-4f8a-b925-74bf622b7567

07/07/2009 07:12 PM <DIR> .
07/07/2009 07:12 PM <DIR> ..
07/07/2009 07:12 PM 764 00000001.CPR
1 File(s) 764 bytes

Directory of Q:\MSCS\f9670a20-d05a-40df-a6f2-f1e6e21022da

06/23/2009 03:50 PM <DIR> .
06/23/2009 03:50 PM <DIR> ..
06/23/2009 03:50 PM 764 00000001.CPR
1 File(s) 764 bytes

Directory of Q:\MSCS\MSDtc

10/07/2013 08:11 PM <DIR> .
10/07/2013 08:11 PM <DIR> ..
0 File(s) 0 bytes

Directory of Q:\MSDtc

06/23/2009 03:50 PM <DIR> .
06/23/2009 03:50 PM <DIR> ..
06/23/2009 03:50 PM 4,194,304 MSDTC.LOG
1 File(s) 4,194,304 bytes

Directory of Q:\RECYCLER

09/09/2012 09:06 AM <DIR> .
09/09/2012 09:06 AM <DIR> ..
09/09/2012 09:06 AM <DIR> S-1-5-21-1394358491-809983319-1777090905-4540
10/13/2010 01:15 PM <DIR> S-1-5-21-1394358491-809983319-1777090905-4632
09/06/2013 01:02 PM <DIR> S-1-5-21-1394358491-809983319-1777090905-500
0 File(s) 0 bytes

Directory of Q:\RECYCLER\S-1-5-21-1394358491-809983319-1777090905-4540

09/09/2012 09:06 AM <DIR> .
09/09/2012 09:06 AM <DIR> ..
09/09/2012 09:06 AM 65 desktop.ini
09/14/2012 01:21 AM 20 INFO2
2 File(s) 85 bytes

Directory of Q:\RECYCLER\S-1-5-21-1394358491-809983319-1777090905-4632

10/13/2010 01:15 PM <DIR> .
10/13/2010 01:15 PM <DIR> ..
10/13/2010 01:15 PM 65 desktop.ini
10/13/2010 06:01 PM 20 INFO2
2 File(s) 85 bytes

Directory of Q:\RECYCLER\S-1-5-21-1394358491-809983319-1777090905-500

09/06/2013 01:02 PM <DIR> .
09/06/2013 01:02 PM <DIR> ..
09/06/2013 01:02 PM 65 desktop.ini
09/27/2013 07:37 AM 20 INFO2
2 File(s) 85 bytes

Total Files Listed:
30 File(s) 4,477,671 bytes
40 Dir(s) 52,877,312 bytes free
Post #1502435
Posted Tuesday, October 8, 2013 4:32 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: General Forum Members
Last Login: Yesterday @ 8:06 PM
Points: 36,786, Visits: 31,243
GilaMonster (10/7/2013)
Jeff Moden (10/7/2013)
our NetOps guys are apparently using the quorum drive to transfer data to our warm DR site.


Oh my, that is horrid cluster design. Nothing but nothing should ever go onto the quorum.

The quorum drive is only responding to what is changing on the SAN drives.


Shouldn't be doing that. There should be no impact on the quorum from the other drives. It's not a staging drive for other cluster drives, all it should be is there to 'arbitrate' ownership of the cluster


Heh... that's likely why things have been such a problem in the past. Thanks, Gail. I wasn't going to get involved in the problem but now it looks like I'll have to.


--Jeff Moden
"RBAR is pronounced "ree-bar" and is a "Modenism" for "Row-By-Agonizing-Row".

First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column."

(play on words) "Just because you CAN do something in T-SQL, doesn't mean you SHOULDN'T." --22 Aug 2013

Helpful Links:
How to post code problems
How to post performance problems
Post #1502538
Posted Tuesday, October 8, 2013 5:55 AM


SSC-Forever

SSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-Forever

Group: General Forum Members
Last Login: Yesterday @ 12:11 PM
Points: 42,470, Visits: 35,541
Jeff Moden (10/8/2013)
Heh... that's likely why things have been such a problem in the past. Thanks, Gail. I wasn't going to get involved in the problem but now it looks like I'll have to.


Ping Allen, Denny or Geoff if you need more advice. What I know about clusters is dangerous.



Gail Shaw
Microsoft Certified Master: SQL Server 2008, MVP
SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

We walk in the dark places no others will enter
We stand on the bridge and no one may pass

Post #1502560
Posted Tuesday, October 8, 2013 6:22 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: General Forum Members
Last Login: Yesterday @ 8:06 PM
Points: 36,786, Visits: 31,243
GilaMonster (10/8/2013)
Jeff Moden (10/8/2013)
Heh... that's likely why things have been such a problem in the past. Thanks, Gail. I wasn't going to get involved in the problem but now it looks like I'll have to.


Ping Allen, Denny or Geoff if you need more advice. What I know about clusters is dangerous.


Same here. I need to read up on it before I'd ping any of those folks. It's a bit embarassing to admit (I've always had a NetOps group that took care of things like clustering) that I know very little about clustering... probably not enough to be "dangerous". I at least have to learn the lingo of clusters so that I can actually understand what they might say so it's time for me to hit the books.

Thanks again for your helpful suggestions, Gail.


--Jeff Moden
"RBAR is pronounced "ree-bar" and is a "Modenism" for "Row-By-Agonizing-Row".

First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column."

(play on words) "Just because you CAN do something in T-SQL, doesn't mean you SHOULDN'T." --22 Aug 2013

Helpful Links:
How to post code problems
How to post performance problems
Post #1502574
Posted Tuesday, October 8, 2013 11:22 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Tuesday, May 6, 2014 5:45 AM
Points: 127, Visits: 307
The one thing is the RECYCLER... which you need to check and clear it out. But i doubt, it will allow you . I do not see files much space used by the cluster files. You can still remove old cluster and DTC files. If you want to be safer... do take back-up.
Post #1502731
Posted Tuesday, October 8, 2013 11:28 AM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Yesterday @ 12:45 PM
Points: 73, Visits: 183
Thanks for your suggestions
Post #1502735
« Prev Topic | Next Topic »

Add to briefcase ««123»»

Permissions Expand / Collapse