Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase 12»»

A Billion Transactions Expand / Collapse
Author
Message
Posted Sunday, April 21, 2013 6:46 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Yesterday @ 3:05 PM
Points: 31,284, Visits: 15,750
Comments posted to this topic are about the item A Billion Transactions






Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #1444791
Posted Sunday, April 21, 2013 8:08 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Thursday, November 6, 2014 1:00 PM
Points: 5,333, Visits: 25,277
Steve, thanks a great read particularly if one follows your link to

http://www.microsoft.com/en-us/news/stories/88acres/88-acres-how-microsoft-quietly-built-the-city-of-the-future-chapter-1.aspx

It has me wondering if someone will create software equal for our private homes ... and if someone does what it will mean to our individual energy bills, and our life styles .


If everything seems to be going well, you have obviously overlooked something.

Ron

Please help us, help you -before posting a question please read

Before posting a performance problem please read
Post #1444796
Posted Monday, April 22, 2013 4:23 AM
SSCrazy

SSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazy

Group: General Forum Members
Last Login: Today @ 3:07 AM
Points: 2,916, Visits: 1,854
I don't think 1 billion transactions per day is that scary any more but then it depends what you mean by transaction. A transaction can be a simple record insert or a batch of records inserted as a single transaction.

It also depends on the read/write mix of traffic to the server, page life expectancy, buffer cache hit ratio etc.

One of our lines of business pushes 100 million records per day precisely how that breaks down to transactions is hard to say but we have another 48 lines of business and running a mix of versions of SQL Server from 2000 onwards and they certainly aren't on high end boxes.


LinkedIn Profile
Newbie on www.simple-talk.com
Post #1444915
Posted Monday, April 22, 2013 5:48 AM
Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: Sunday, November 23, 2014 7:49 PM
Points: 59, Visits: 307
It would be great if stock market activity was evenly distributed throughout the day but the actual profile has huge spikes. Here in the US, normal market hours are 9:30-16:00 Eastern and much of the activity on a typical day is at market open as well shortly before market close. Also, news events can cause spikes at any time throughout the day.

This sort of transaction profile is a real challenge in capacity planning because one must plan for the peaks rather than the average and every millisecond counts due to the time-sensitive nature of these transactions.


Post #1444935
Posted Monday, April 22, 2013 7:10 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 3:19 AM
Points: 5,765, Visits: 3,680
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers"


Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!
Post #1444971
Posted Monday, April 22, 2013 8:46 AM


SSC-Dedicated

SSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-DedicatedSSC-Dedicated

Group: Administrators
Last Login: Yesterday @ 3:05 PM
Points: 31,284, Visits: 15,750
Gary Varga (4/22/2013)
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers"


Good points, and I think over time the idea of classifying data, aggregating some of it and tossing other parts will become more important.

I wasn't trying to slight anyone, but make sure our focus is on building these apps that help people in some way, not just meet some spec without necessarily accomplishing something meaningful for the task.







Follow me on Twitter: @way0utwest

Forum Etiquette: How to post data/code on a forum to get the best help
Post #1445018
Posted Monday, April 22, 2013 9:39 AM


SSC Rookie

SSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC Rookie

Group: General Forum Members
Last Login: Monday, September 15, 2014 9:27 AM
Points: 34, Visits: 195
I remember when I had to stop using int in favor of bigint in the identity field of a few of my tables. I don't think I have any that record a billion a day yet though.



SQL Tips and Scripts
SQLWorks Blog
Post #1445040
Posted Monday, April 22, 2013 9:53 AM
SSCrazy

SSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazySSCrazy

Group: General Forum Members
Last Login: Friday, November 21, 2014 10:15 AM
Points: 2,464, Visits: 1,551
Steve Jones - SSC Editor (4/22/2013)
Gary Varga (4/22/2013)
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers"


Good points, and I think over time the idea of classifying data, aggregating some of it and tossing other parts will become more important.

I wasn't trying to slight anyone, but make sure our focus is on building these apps that help people in some way, not just meet some spec without necessarily accomplishing something meaningful for the task.


For the most part I agree, meet needs do not just meet specifications. But some well thought out specifications can be very useful. They should be subject to review, subject to summarizations etc, but some of those specifications are really nice to have in place since the developer might not know what the ancillary need is the specifications meet.



Not all gray hairs are Dinosaurs!
Post #1445046
Posted Monday, April 22, 2013 11:24 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 3:19 AM
Points: 5,765, Visits: 3,680
Steve Jones - SSC Editor (4/22/2013)
Gary Varga (4/22/2013)
I also think that we are going to have learn to throw away more data too. This will probably be a rough road in data management. Those of you who are major influencers in such things will have to assist businesses in deciding, perhaps more than ever, what data to keep in what granularity and for how long. This may be BI data related process and it feels somewhat like that to me. Perhaps this is just part of some of your jobs in the data warehousing arena.

Of course, I hope Steve wasn't slighting us developers as being unprofessional when he said "SQL Server professionals and developers"


Good points, and I think over time the idea of classifying data, aggregating some of it and tossing other parts will become more important.

I wasn't trying to slight anyone, but make sure our focus is on building these apps that help people in some way, not just meet some spec without necessarily accomplishing something meaningful for the task.


I don't think anyone would really think you were trying to slight anyone. A good editorial again. Thanks.


Gaz

-- Stop your grinnin' and drop your linen...they're everywhere!!!
Post #1445084
Posted Tuesday, April 23, 2013 5:39 PM


SSCoach

SSCoachSSCoachSSCoachSSCoachSSCoachSSCoachSSCoachSSCoachSSCoachSSCoachSSCoach

Group: General Forum Members
Last Login: Yesterday @ 9:21 AM
Points: 17,977, Visits: 15,981
bitbucket-25253 (4/21/2013)
Steve, thanks a great read particularly if one follows your link to

http://www.microsoft.com/en-us/news/stories/88acres/88-acres-how-microsoft-quietly-built-the-city-of-the-future-chapter-1.aspx

It has me wondering if someone will create software equal for our private homes ... and if someone does what it will mean to our individual energy bills, and our life styles .


+1

Some of those systems are already becoming available for homeowners. I can foresee many more over the years.




Jason AKA CirqueDeSQLeil
I have given a name to my pain...
MCM SQL Server, MVP


SQL RNNR

Posting Performance Based Questions - Gail Shaw
Post #1445729
« Prev Topic | Next Topic »

Add to briefcase 12»»

Permissions Expand / Collapse