April 22, 2007 at 6:44 pm
Who wants to manage a 40PB database? That's what SAIC and the University of Hawaii are building. They're putting together a database for astronomy data, searching for killer asteroids and what-not, and expecting to generate 10TB a week.
Wow!
Last week at the Colorado Code Camp, we did a survey of who had the largest databases, trying to give away some prizes, and the winner was in the 600GB range. Not a huge database from the 80 people there, but maybe the guys with the 13TB database couldn't get time off from work 🙂
SQL Server is certainly getting more stresses in this area. Kevin Cox of Microsoft gave the keynote last week and talked about the large systems they're working on with customers, including a 270TB database.
I used to want to work on larger databases, get experience and work out the challenges of dealing with very large systems. Mr. Cox talked about a few of them in his keynote and some of the ways they deal with administrative challenges, like using read-only filegroups and not backing them up all the time. And what about moving a copy of the db to a remote site? Can't really move 100s of TB across a network, at least not in a realistic time.
My solution? FedEx!
Connect a SAN, copy disks over and then pack it on a pallet and call the purple and orange. Or purple and green. or whatever color you use. Brown anyone?
I think working on a VLDB is pretty cool, but it's a challenge for some of you out there. I'm not sure I want the stress of handling that much data, but I definitely respect those of you that do it on a daily basis.
Steve Jones
April 23, 2007 at 8:31 am
I wish they would have given some details of the hardware/software behind the scenes... What op. system ? What RDBMS ?
Viewing 2 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply