Click here to monitor SSC
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


A Billion Transactions


A Billion Transactions

Author
Message
Steve Jones
Steve Jones
SSC-Forever
SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)

Group: Administrators
Points: 41390 Visits: 18876
Comments posted to this topic are about the item A Billion Transactions

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
bitbucket-25253
bitbucket-25253
SSCertifiable
SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)SSCertifiable (6.3K reputation)

Group: General Forum Members
Points: 6273 Visits: 25280
Steve, thanks a great read particularly if one follows your link to

http://www.microsoft.com/en-us/news/stories/88acres/88-acres-how-microsoft-quietly-built-the-city-of-the-future-chapter-1.aspx

It has me wondering if someone will create software equal for our private homes ... and if someone does what it will mean to our individual energy bills, and our life styles .

If everything seems to be going well, you have obviously overlooked something.

Ron

Please help us, help you -before posting a question please read

Before posting a performance problem please read
David.Poole
David.Poole
SSCarpal Tunnel
SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)SSCarpal Tunnel (4.5K reputation)

Group: General Forum Members
Points: 4488 Visits: 3182
I don't think 1 billion transactions per day is that scary any more but then it depends what you mean by transaction. A transaction can be a simple record insert or a batch of records inserted as a single transaction.

It also depends on the read/write mix of traffic to the server, page life expectancy, buffer cache hit ratio etc.

One of our lines of business pushes 100 million records per day precisely how that breaks down to transactions is hard to say but we have another 48 lines of business and running a mix of versions of SQL Server from 2000 onwards and they certainly aren't on high end boxes.

LinkedIn Profile

Newbie on www.simple-talk.com
Dan Guzman-481633
Dan Guzman-481633
SSC-Enthusiastic
SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)SSC-Enthusiastic (110 reputation)

Group: General Forum Members
Points: 110 Visits: 392
It would be great if stock market activity was evenly distributed throughout the day but the actual profile has huge spikes. Here in the US, normal market hours are 9:30-16:00 Eastern and much of the activity on a typical day is at market open as well shortly before market close. Also, news events can cause spikes at any time throughout the day.

This sort of transaction profile is a real challenge in capacity planning because one must plan for the peaks rather than the average and every millisecond counts due to the time-sensitive nature of these transactions.
Gary Varga
Gary Varga
SSChampion
SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)

Group: General Forum Members
Points: 10431 Visits: 6351
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers" :-P

Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!
Steve Jones
Steve Jones
SSC-Forever
SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)SSC-Forever (41K reputation)

Group: Administrators
Points: 41390 Visits: 18876
Gary Varga (4/22/2013)
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers" :-P


Good points, and I think over time the idea of classifying data, aggregating some of it and tossing other parts will become more important.

I wasn't trying to slight anyone, but make sure our focus is on building these apps that help people in some way, not just meet some spec without necessarily accomplishing something meaningful for the task.

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
SQLWorks
SQLWorks
SSC Rookie
SSC Rookie (40 reputation)SSC Rookie (40 reputation)SSC Rookie (40 reputation)SSC Rookie (40 reputation)SSC Rookie (40 reputation)SSC Rookie (40 reputation)SSC Rookie (40 reputation)SSC Rookie (40 reputation)

Group: General Forum Members
Points: 40 Visits: 195
I remember when I had to stop using int in favor of bigint in the identity field of a few of my tables. I don't think I have any that record a billion a day yet though.



SQL Tips and Scripts
SQLWorks Blog
Miles Neale
Miles Neale
SSCrazy
SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)SSCrazy (2.8K reputation)

Group: General Forum Members
Points: 2756 Visits: 1694
Steve Jones - SSC Editor (4/22/2013)
Gary Varga (4/22/2013)
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers" :-P


Good points, and I think over time the idea of classifying data, aggregating some of it and tossing other parts will become more important.

I wasn't trying to slight anyone, but make sure our focus is on building these apps that help people in some way, not just meet some spec without necessarily accomplishing something meaningful for the task.


For the most part I agree, meet needs do not just meet specifications. But some well thought out specifications can be very useful. They should be subject to review, subject to summarizations etc, but some of those specifications are really nice to have in place since the developer might not know what the ancillary need is the specifications meet. :-)

Not all gray hairs are Dinosaurs!
Gary Varga
Gary Varga
SSChampion
SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)SSChampion (10K reputation)

Group: General Forum Members
Points: 10431 Visits: 6351
Steve Jones - SSC Editor (4/22/2013)
Gary Varga (4/22/2013)
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers" :-P


Good points, and I think over time the idea of classifying data, aggregating some of it and tossing other parts will become more important.

I wasn't trying to slight anyone, but make sure our focus is on building these apps that help people in some way, not just meet some spec without necessarily accomplishing something meaningful for the task.


I don't think anyone would really think you were trying to slight anyone. A good editorial again. Thanks.

Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!
SQLRNNR
SQLRNNR
SSC-Insane
SSC-Insane (23K reputation)SSC-Insane (23K reputation)SSC-Insane (23K reputation)SSC-Insane (23K reputation)SSC-Insane (23K reputation)SSC-Insane (23K reputation)SSC-Insane (23K reputation)SSC-Insane (23K reputation)

Group: General Forum Members
Points: 23213 Visits: 18271
bitbucket-25253 (4/21/2013)
Steve, thanks a great read particularly if one follows your link to

http://www.microsoft.com/en-us/news/stories/88acres/88-acres-how-microsoft-quietly-built-the-city-of-the-future-chapter-1.aspx

It has me wondering if someone will create software equal for our private homes ... and if someone does what it will mean to our individual energy bills, and our life styles .


+1

Some of those systems are already becoming available for homeowners. I can foresee many more over the years.



Jason AKA CirqueDeSQLeil
I have given a name to my pain...
MCM SQL Server, MVP


SQL RNNR

Posting Performance Based Questions - Gail Shaw

Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search