Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase ««12345»»»

Backup and restore solution for 800TB of data Expand / Collapse
Author
Message
Posted Thursday, April 29, 2010 7:34 AM


SSC-Forever

SSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-Forever

Group: General Forum Members
Last Login: Yesterday @ 3:37 PM
Points: 40,210, Visits: 36,619
Are you sure it's TB, not GB? A log file cannot be bigger than 2TB.


Gail Shaw
Microsoft Certified Master: SQL Server 2008, MVP
SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

We walk in the dark places no others will enter
We stand on the bridge and no one may pass

Post #912832
Posted Thursday, April 29, 2010 7:35 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Thursday, October 23, 2014 6:53 AM
Points: 13,890, Visits: 28,285
If this turns out to be gigs, I'm going to cry. I was terribly excited about an 800TB system.

----------------------------------------------------
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood..." Theodore Roosevelt
The Scary DBA
Author of: SQL Server Query Performance Tuning
SQL Server 2012 Query Performance Tuning
SQL Server 2008 Query Performance Tuning Distilled
and
SQL Server Execution Plans

Product Evangelist for Red Gate Software
Post #912834
Posted Thursday, April 29, 2010 7:40 AM


Old Hand

Old HandOld HandOld HandOld HandOld HandOld HandOld HandOld Hand

Group: General Forum Members
Last Login: Thursday, October 2, 2014 7:11 AM
Points: 368, Visits: 3,076
Grant Fritchey (4/29/2010)
If this turns out to be gigs, I'm going to cry. I was terribly excited about an 800TB system.


Me too.
Post #912841
Posted Thursday, April 29, 2010 7:41 AM


SSC Eights!

SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!

Group: General Forum Members
Last Login: Monday, March 17, 2014 6:21 AM
Points: 997, Visits: 6,477
My bet is on GB's not TB.

-------------------------------------------------------------
"It takes 15 minutes to learn the game and a lifetime to master"
"Share your knowledge. It's a way to achieve immortality."


Post #912843
Posted Thursday, April 29, 2010 7:45 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Thursday, April 17, 2014 4:56 AM
Points: 1,002, Visits: 884
Aside from the fact that the largest size of a DB os 500TB, assuming you even had something that large.

How Many:
Teamed Network Cards?
HBA Controllers?
Drives (Max MDF file is on 16TB)

What server could handle 25 1GB network cards and 50 controller's?

How much total SAN space does the enterprise have? Few places have 1 PB of SAN Space just for data, let alone backups.

It could not be backed up over copper, fibre would still be very time consuming, even with the best router?

You could never DR it, the amount of time to logship/mirror multiple T3's would be very long...plus you would need that much space at the DR side.

I'm sure it's 800GB, but it's interesting to think of it it could be 800TB. However, I think given a max DB size of 500TB, he has to mean 800GB


/* ----------------------------- */
Tochter aus Elysium, Wir betreten feuertrunken, Himmlische, dein Heiligtum!

Post #912853
Posted Thursday, April 29, 2010 7:47 AM


Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Monday, September 22, 2014 2:32 AM
Points: 1,260, Visits: 3,423
If the situation is true, it would be very interesting about DB architecture info ( data files & log files architecture )

============================================================
SELECT YOUR PROBLEM FROM SSC.com WHERE PROBLEM DESCRIPTION =
http://www.sqlservercentral.com/articles/Best+Practices/61537/
Post #912857
Posted Thursday, April 29, 2010 7:50 AM


SSC-Forever

SSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-ForeverSSC-Forever

Group: General Forum Members
Last Login: Yesterday @ 3:37 PM
Points: 40,210, Visits: 36,619
GregoryF (4/29/2010)
Are you really sure it's 800TB and not 800GB?

SQL 2008 only support 512TB Databases
http://msdn.microsoft.com/en-us/library/ms143432.aspx

So does SQL 2005
http://msdn.microsoft.com/en-us/library/ms143432(SQL.90).aspx


No. Not 512 TB. 524,272 TB. 524 PB (petabytes)



Gail Shaw
Microsoft Certified Master: SQL Server 2008, MVP
SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

We walk in the dark places no others will enter
We stand on the bridge and no one may pass

Post #912860
Posted Thursday, April 29, 2010 7:52 AM


Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Monday, September 22, 2014 2:32 AM
Points: 1,260, Visits: 3,423
GregoryF (4/29/2010)
Are you really sure it's 800TB and not 800GB?

SQL 2008 only support 512TB Databases
http://msdn.microsoft.com/en-us/library/ms143432.aspx

So does SQL 2005
http://msdn.microsoft.com/en-us/library/ms143432(SQL.90).aspx


No SQL Server supports over 512 TB, take a look more closely, the MAX spec. is 524272 TB (that's means in Peta Bytes)! So if the situation is true, it can be !


============================================================
SELECT YOUR PROBLEM FROM SSC.com WHERE PROBLEM DESCRIPTION =
http://www.sqlservercentral.com/articles/Best+Practices/61537/
Post #912862
Posted Thursday, April 29, 2010 7:58 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Thursday, April 17, 2014 4:56 AM
Points: 1,002, Visits: 884
Dugi (4/29/2010)
GregoryF (4/29/2010)
Are you really sure it's 800TB and not 800GB?

SQL 2008 only support 512TB Databases
http://msdn.microsoft.com/en-us/library/ms143432.aspx

So does SQL 2005
http://msdn.microsoft.com/en-us/library/ms143432(SQL.90).aspx


No SQL Server supports over 512 TB, take a look more closely, the MAX spec. is 524272 TB (that's means in Peta Bytes)! So if the situation is true, it can be !


Thanks, I did not notice the factor of 100, I'm not used to files of such size...

But with a 16TB limit on datafiles, you would still need 50 datafiles. With a limit of 2TB on logs, 50 logs. That's an unrealistic number of drives with corresponding HBA cards. And both of those numbers assume that all files are at 100%.

The server that could process all of this, and the SAN that could store it, and the networking that can transfer it, would out of reach for all but the richest of companies.

If it's true, I'd love to play with it


/* ----------------------------- */
Tochter aus Elysium, Wir betreten feuertrunken, Himmlische, dein Heiligtum!

Post #912870
Posted Thursday, April 29, 2010 8:26 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Thursday, October 23, 2014 1:17 AM
Points: 1,188, Visits: 1,552
Steve Jones - Editor (4/29/2010)

Also, I'm curious how you are backing up the log every 10 sec. Are you using some external program. AFAIK, jobs to schedule can be done every minute, not more granular than that.



2008 can indeed go down to seconds, but I can't say I had noticed it before.
Post #912904
« Prev Topic | Next Topic »

Add to briefcase ««12345»»»

Permissions Expand / Collapse