Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase 12»»

Disk Subsystem Expand / Collapse
Author
Message
Posted Friday, March 21, 2008 10:29 AM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, November 9, 2012 2:48 PM
Points: 493, Visits: 636
I want a recommendation on a disk subsystem for my OLTP system. I will configure it to RAID 5 and maybe a portion of it to RAID 10. My SQL Server will do about 30 million transactions a day. I know this is a really general spec, but I just need some pointers. I would like an affordable system with roughly .5 - 1 TB. Any advice would be much appreciated. Like - should I go with SAS/SATA, SCSI, what kind of storage enclosure, what brands are best etc.

Thank you
Post #472968
Posted Saturday, March 22, 2008 9:03 PM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Yesterday @ 5:13 PM
Points: 33,100, Visits: 15,210
No idea on the disk types to choose, go with the fastest throughput you can.

Do not use R5, except maybe for backups. www.baarf.com has good reasons to stick with R1 or R10.

The daily transaction count doesn't matter, it depends on how it's distributed. 30M in one hour and 0 the rest of the day is different than 30M evenly spread.

You want to separate things out that have contention. If you have a busy write/update server, then you might want an R1 array for your logs. If you have heavy queries, then you might want separate R1/R10 arrays for certain tables or indexes away from data.

Memory is probably more important, so be sure that you have a high buffer cache hit ratio no matter what the disk is.







Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #473272
Posted Sunday, March 23, 2008 9:36 AM
SSC Rookie

SSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC Rookie

Group: General Forum Members
Last Login: Thursday, July 24, 2014 8:14 PM
Points: 29, Visits: 85
Steve Jones is wise you should listen to him.

RAID 5 is slow, RAID 1 is nice but a drive error results in an outage, RAID 10 is the best if you require 100% uptime.

Network attached storage devices that have SCSI interfaces are expensive but nice.
Post #473309
Posted Monday, March 24, 2008 9:26 AM
Grasshopper

GrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopperGrasshopper

Group: General Forum Members
Last Login: Thursday, December 11, 2008 9:36 PM
Points: 18, Visits: 97
I would say a SAN or NAS over a DAS, because to model DISK IO is a little hard.

I would look for a system that will let me expand a raid group or create a raid groups and expose it to the OS with out down time.
Let say you start with a raid group A 1_0, 20 drives, 15,000 RPM SAS, fiber. 10 disk are available for writes and 20 disk available for reads. You find your self with bad performance. No or limited maintenance windows. Also who want to work till 4 in the morning? A SAN or NAS will let me expand the file group I might add 6 disk to my raid group A 1_0 to increase IO or I might create a new file group and move some tables or indexes over to it. Balance my IO. Flexablity means cost. I would look at NETAPP NAS (cheap) or Go with a IBM DS8000 ( Expensive).
SAS Drive is design to run for 5 years where SATA is an upgrade to PATA drive and is designed on average for systems that is not running all day.
Post #473526
Posted Tuesday, March 25, 2008 1:42 AM
Old Hand

Old HandOld HandOld HandOld HandOld HandOld HandOld HandOld Hand

Group: General Forum Members
Last Login: Thursday, March 6, 2014 6:13 PM
Points: 318, Visits: 1,183
What Steve Jones said, except that I wouldn't entirely rule out RAID5 - it's suitable for a workload heavily biased towards reads with little/no write activity and lower recovery SLAs, maybe a second tier large read-only DB or staged reporting DB with infrequent data loads. EDIT: Actually you said OLTP so forgot this part - RAID5 has no place here.

@pdross2000:
I think you are thinking of RAID0. RAID1 can survive a single disk failure just fine with no outage.

@Robert.concepcion:
I generally wouldn't recommend any NAS solution - having a file-level network redirector between your server and the data files is asking for trouble. Go for SAN or DAS - data files on NAS is a pretty narrowly supported scenario from MS. That said NetApp have a SAN (block-level) solution in most of their products don't they?

Regards,

Jacob
Post #473890
Posted Tuesday, March 25, 2008 7:27 AM


SSCarpal Tunnel

SSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal Tunnel

Group: General Forum Members
Last Login: Friday, July 25, 2014 3:19 AM
Points: 4,320, Visits: 6,113
I am quite frankly astonished that you are asking on this forum for disk advice when you are developing a system that will process over 20K transactions per minute 24/7 on average!! See here for just a few of the things that make this level of processing difficult: http://sqlblog.com/blogs/paul_nielsen/archive/2007/12/12/10-lessons-from-35k-tps.aspx.

If you truly need that level of performance, you best get yourself a top-level DBA and get him/her involved in this from the ground up!! There are and incredible array of things that can/should be done/configured to achieve optimal performance of a SQL Server system - much more than just the disk system too. :)


Best,

Kevin G. Boles
SQL Server Consultant
SQL MVP 2007-2012
TheSQLGuru at GMail
Post #474046
Posted Tuesday, March 25, 2008 9:10 AM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, November 9, 2012 2:48 PM
Points: 493, Visits: 636
Thank you everybody except the SQLGuru whos comments were entirely unhelpful and implied that I am not a top level DBA.
Post #474146
Posted Tuesday, March 25, 2008 9:18 AM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, November 9, 2012 2:48 PM
Points: 493, Visits: 636
P.S. as I expected your link bared no relevance to my question as it implemented complex business logic and 35k tps instead of my desired 200 to 400 tps. If you don't like a forum question please don't waste people time with unhelpful commentary.
Post #474158
Posted Tuesday, March 25, 2008 9:33 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Yesterday @ 5:13 PM
Points: 33,100, Visits: 15,210
I think SQLGuru expressed concern that you're trying to solve a complex problem, meaning a very, very busy system, based on community advice. That type of system is one that very few people have worked on and so the advice you get here might not be relevant.

The concern there is that you are asking the question becuase you aren't experienced and will rely on this information, which is not what you should do.

If you are experienced, and are just looking for other opinions, that's fine. However if you are in doubt, then SQLGuru's advice of hiring a consultant experienced in high tps levels makes sense.

It's not an insult, we have no idea what your experience level is.







Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #474176
Posted Tuesday, March 25, 2008 10:27 AM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, November 9, 2012 2:48 PM
Points: 493, Visits: 636
Thank you Steve, I agree with what you are saying. I am not recommending any purchases be made based on the advice I received on this thread, but rather, I am just placing feelers out there. TheSQLGuru did not address my question, but assumed what he thought my real issue was, and so I suppose that is fair since this is an open ended forum.

The point I would like to make though, is that I am interested in disk subsystems (Direct attach, NAS, SAN) and I am not interested in what TheSQLGuru "perceives" my problem to be.

Instead of making assumptions he could ask a question like "hmm will there be peeks during the day or will all transactions be spread evenly?" or "hmm will there be a maintenance window?"

Instead he posted a link that talked about iterative versus set based approach serving up 35,000 tps???

I don't take offense, It's free forum so long as we are respectful of one another, I just didn't feel it was at all a productive post and wanted to give him that feedback.

Thanks
Post #474221
« Prev Topic | Next Topic »

Add to briefcase 12»»

Permissions Expand / Collapse