Click here to monitor SSC
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


Keeping It All In Memory


Keeping It All In Memory

Author
Message
GSquared
GSquared
SSChampion
SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)

Group: General Forum Members
Points: 14375 Visits: 9729
From what I understand, most tempdb operations already take place purely in RAM, till they get too big to fit there. Temp tables and table variables both work that way. Maybe transaction log actions on temp tables involve disk I/O, I'm not sure. If they do, they could be moved into a RAM version of the tran log just for tempdb and that might improve performance by some tiny amount on really busy systems.

- Gus "GSquared", RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
Property of The Thread

"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon
Jon Saltzman
Jon Saltzman
Valued Member
Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)

Group: General Forum Members
Points: 60 Visits: 147
Actually, for a little while (in SQL 2000) we used to pin tables in memory using the "dbcc pintable" command. It didn't load the entire table into memory by default, but once pages were read from disk, they would be cached in memory until you "unpinned" the table or restarted the server. This was pretty close to an in-memory database... for those tables which you pinned. However, this feature was deprecated in SQL 2005, mostly because the SQL engine does this kind of in-memory caching of pages automatically, as long as there is enough RAM (or so I have read). I was kind of sad to see it go though, because it did give a little bit of extra control and possibility for using all that RAM that servers have these days.

Jon
Jeff Moden
Jeff Moden
SSC-Forever
SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)

Group: General Forum Members
Points: 45110 Visits: 39915
It's ironic... as someone once said, "The more things change, the more they stay the same". Holy shades of "RAM DISK", Batman! :-P

--Jeff Moden

RBAR is pronounced ree-bar and is a Modenism for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column.
Although they tell us that they want it real bad, our primary goal is to ensure that we dont actually give it to them that way.
Although change is inevitable, change for the better is not.
Just because you can do something in PowerShell, doesnt mean you should. Wink

Helpful Links:
How to post code problems
How to post performance problems
Forum FAQs
GSquared
GSquared
SSChampion
SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)SSChampion (14K reputation)

Group: General Forum Members
Points: 14375 Visits: 9729
Jeff Moden (2/1/2010)
It's ironic... as someone once said, "The more things change, the more they stay the same". Holy shades of "RAM DISK", Batman! :-P


I thought the same thing.

Sure would add a lot of challenges to DR, but might get a little boost in performance. I think I'd aim more for SSD instead of in-RAM databases, if I really needed just that tiny edge in speed. Less risky, lots faster than HDD.

- Gus "GSquared", RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
Property of The Thread

"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon
Girish Bhat
Girish Bhat
SSC Veteran
SSC Veteran (215 reputation)SSC Veteran (215 reputation)SSC Veteran (215 reputation)SSC Veteran (215 reputation)SSC Veteran (215 reputation)SSC Veteran (215 reputation)SSC Veteran (215 reputation)SSC Veteran (215 reputation)

Group: General Forum Members
Points: 215 Visits: 428
In-memory databases are suitable for a specific set of applications which need extreme performance without worrying too much about recoverability. In such apps recoverability is handled outside the database by the app itself using custom logic. One example would be a stock market order matching engine where tens of thousands of transactions are done per second. Recovering from system failure is handled by the application by rebuilding the IMDB from various sources. Such systems fall under a narrow niche category. A majority of apps need persistence and cannot use IMDBs (at least not till reliable recoverability is built-in).

I would like to see an IMDB version of SQL Server Compact Edition - the zero install embedded database. If that happens, a massive number of desktop applications, Windows service applications and small to medium websites can use it as a local cache in innumerable performance enhancement situations in the form of a multi-key hashtable which can be queried with regular SQL.
Jeff Moden
Jeff Moden
SSC-Forever
SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)SSC-Forever (45K reputation)

Group: General Forum Members
Points: 45110 Visits: 39915
Instrumented data collection apps, especially in the medical and device control fields, would greatly benefit from IMDB instances as well.

--Jeff Moden

RBAR is pronounced ree-bar and is a Modenism for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column.
Although they tell us that they want it real bad, our primary goal is to ensure that we dont actually give it to them that way.
Although change is inevitable, change for the better is not.
Just because you can do something in PowerShell, doesnt mean you should. Wink

Helpful Links:
How to post code problems
How to post performance problems
Forum FAQs
David Lean
David Lean
SSC Rookie
SSC Rookie (42 reputation)SSC Rookie (42 reputation)SSC Rookie (42 reputation)SSC Rookie (42 reputation)SSC Rookie (42 reputation)SSC Rookie (42 reputation)SSC Rookie (42 reputation)SSC Rookie (42 reputation)

Group: General Forum Members
Points: 42 Visits: 129
For the niche solutions you mention above check out the StreamInsight component that ships with SQL Server 2008 R2 (currently in beta (as of Feb 2010)).
I think you'll find it meets your needs beautifully. It ships & is licensed as part of SQL Server, but can run as a separate component hence can be configured for way less overhead than running entire SQL stack if you only need the high speed matching bits.
Jon Saltzman
Jon Saltzman
Valued Member
Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)

Group: General Forum Members
Points: 60 Visits: 147
StreamInsight and SQL 2008 R2 should be RTM in May 2010. See this article for more info about the release.

I'm excited about the great new features! It's a good time to be a SQL Server user!

Jon
Steve Jones
Steve Jones
SSC-Dedicated
SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)SSC-Dedicated (36K reputation)

Group: Administrators
Points: 36136 Visits: 18745
Streaminsight looks good, unfortunately in SS2K8 R2 it's only in data center edition Sad

So most of us won't get to use it. We can play in Developer, but to actually deploy it would take some serious $$$$

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
Jon Saltzman
Jon Saltzman
Valued Member
Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)Valued Member (60 reputation)

Group: General Forum Members
Points: 60 Visits: 147
Steve, isn't that always how it goes? Wink
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search