SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


NewSQL Can Save the World


NewSQL Can Save the World

Author
Message
Steve Jones
Steve Jones
SSC Guru
SSC Guru (149K reputation)SSC Guru (149K reputation)SSC Guru (149K reputation)SSC Guru (149K reputation)SSC Guru (149K reputation)SSC Guru (149K reputation)SSC Guru (149K reputation)SSC Guru (149K reputation)

Group: Administrators
Points: 149370 Visits: 19448
Comments posted to this topic are about the item NewSQL Can Save the World

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
Dennis Cohoon
Dennis Cohoon
Forum Newbie
Forum Newbie (8 reputation)Forum Newbie (8 reputation)Forum Newbie (8 reputation)Forum Newbie (8 reputation)Forum Newbie (8 reputation)Forum Newbie (8 reputation)Forum Newbie (8 reputation)Forum Newbie (8 reputation)

Group: General Forum Members
Points: 8 Visits: 26
I read, "At least I hope.." and "perhaps.." in this editoral, and regain the memory of the funniest database parody I have ever heard:

www dot xtranormal dot com / watch / 6995033 / mongo-db-is-web-scale

Please enjoy!
cengland0
cengland0
SSCrazy
SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)SSCrazy (2.3K reputation)

Group: General Forum Members
Points: 2256 Visits: 1300
Running in memory scares me, ... ... I still think a large scale power failure could be disastrous, so I assume these products do write to disk at some point.

Depends on what type of memory. There are many different technologies. Some are non-volatile memory which retains it's state even if the power is turned off. The newer SSD drives are memory and will retain it's information during a power failure as well.
richardd
richardd
Hall of Fame
Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)Hall of Fame (3.2K reputation)

Group: General Forum Members
Points: 3244 Visits: 648
So a man who runs a company which sells a competitor to "oldSQL" products has given an interview saying the "oldSQL" is bad, and his "newSQL" competitor is doubleplusgood?

OK, I'll trust every word he says then. Rolleyes



Revenant
Revenant
SSChampion
SSChampion (12K reputation)SSChampion (12K reputation)SSChampion (12K reputation)SSChampion (12K reputation)SSChampion (12K reputation)SSChampion (12K reputation)SSChampion (12K reputation)SSChampion (12K reputation)

Group: General Forum Members
Points: 12653 Visits: 5010
cengland0 (7/26/2011)
Running in memory scares me, ... ... I still think a large scale power failure could be disastrous, so I assume these products do write to disk at some point.

Depends on what type of memory. There are many different technologies. Some are non-volatile memory which retains it's state even if the power is turned off. The newer SSD drives are memory and will retain it's information during a power failure as well.

Azure is indeed a "VM in the cloud"; however, it is stateless. Azure Storage Services offer you two choices of persisting your data: either in a fully relational SQL Azure database - SQLS with lots of restrictions -, or in Azure Tables. Azure Tables are a fast, non-relational lightweight service that typically stores entities and properties. Azure blobs are for arbitrary binary data - contents is whatever you put there.
Mad Myche
Mad Myche
Old Hand
Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)

Group: General Forum Members
Points: 363 Visits: 520
Running solely in (ram) memory scares me as well, and almost dictates that you operate as a multi-node system.
I would hope that there is a "save to disk" operation that could be invoked (by default) when you choose to shutdown the server/service.
I briefly read through the C# sample and the commands seemed a little ambiguous. I guess I like structure too much

Director of Transmogrification Services
Eric M Russell
Eric M Russell
One Orange Chip
One Orange Chip (29K reputation)One Orange Chip (29K reputation)One Orange Chip (29K reputation)One Orange Chip (29K reputation)One Orange Chip (29K reputation)One Orange Chip (29K reputation)One Orange Chip (29K reputation)One Orange Chip (29K reputation)

Group: General Forum Members
Points: 29563 Visits: 11542
Efficient relational database design is about constraints, normalization, and discrete data types. The problem faced by companies like FaceBook is not that their databases are large or that they have a lot of users (other organizations like banks and governments handle similar data and user loads), but rather the type of content they contain in the database: nested hierarchies, entity-attribute-values, BLOBs, and click stream recording.


"The universe is complicated and for the most part beyond your control, but your life is only as complicated as you choose it to be."
justinb486
justinb486
SSC-Enthusiastic
SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)SSC-Enthusiastic (100 reputation)

Group: General Forum Members
Points: 100 Visits: 92
We have been looking at SAP HANA - their in memory column store database. The demonstrated performance for a 6TB database was phenomenal - for reading... but we've a lot of questions re read/write and getting those log entries to disk just as quickly. This has been designed from the ground up for in-memory optimisation, including the application sitting on top.

This may be a way to go for reporting, analytics, planning and heavy business planning processes, but moving an ERP system into memory even on highly resilient IBM POWER7 architecture is a scary concept.

Another question for these systems is 'how long does it take to load 6TB+ into memory on restart' or DR?

Microsoft Research is also working on Trinity, an in-memory Hypergraph database which looks very nice as an in-memory, up to 100 node, object store - backed onto SQL for data integrity, storage and reporting. Its code is similar to MSAGL from some time back for visual graphing, so should be very accessible when stacked atop MS SQL.



Mad Myche
Mad Myche
Old Hand
Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)Old Hand (363 reputation)

Group: General Forum Members
Points: 363 Visits: 520
If only I was a Linux person and had the time to play...

The little light bulb went on when I was discussing this with a co-worker. I think there may be a real potential for this when coupled with the LPS distro ( a Defense Dept Linux run from CD or Flash drive). It would kind of be like an industrial version of the Android/Sql-Lite combo

Director of Transmogrification Services
David In BC
David In BC
SSC Journeyman
SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)SSC Journeyman (98 reputation)

Group: General Forum Members
Points: 98 Visits: 375
We evaluated an in-memory database a while back (Times Ten), and data was persisted to disk, just not as frequently. The database read all the data from disk into memory at startup, and wrote to disk as it changed.

An in-memory database usually means that, post-startup, the database doesn't go to disk to read.

I have a former co-worker who works for MySQL. She said that several former MySQL engineers work for Facebook, and MySQL has a team devoted just to supporting the social media company. The type of tickets Facebook tends to log with MySQL are,

"I was debugging mysql and this mutex in the whatsit is staying locked even though the whatsit should not be in use".

At Facebook, they have an understanding of MySQL that goes all the way down to the metal.

As a former MySQL and Oracle DBA, I say that you shouldn't knock it till you try it.
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search