June 11, 2004 at 7:17 pm
my database reach 100 million data. i frequently recieved buggs like 'connection timeout' and the process of searching is getting slower everyday. i know this is because of the huge data. the question that i want to address is which is better? i will create a new database for the storage of history file or add another tables for the history? is it also possible to have 2 or more computer to power up the sql server process? thanx for the help.
June 14, 2004 at 8:22 am
100 million doesn't actually seem like a lot. Have you verified you have the proper indexes for you needs.
However if the data has nice break points to make smaller tables it will help especially if you can place on seperate file groups and those on seperate drive arrays. I personally have used historical tables based on year as the data had a non-changing date field that would not force me to move between tables. Then you can create a view to pull together.
And yes you can create distirbuted queries to utilize multiple servers.
There are always bennifits to ditributing the load but make sure you have a good solid network between the two machines.
June 15, 2004 at 5:29 am
thanx for the answers. regarding about the views and tables. hmmm did you mean that once you initialize the posting of history the program or tsql automatically creates a table with a name of its date or something related to it, then creates a views to filter things out? is it right?
any information or links on distributed queries?
my real question is how do you combine multiple computer to act as 1 in order to get greater speed. like achieving teraflops speed like super computers. example japan earth simulator which is no1 is composed of 5,120 (640 8-way nodes) 500 MHz NEC CPUs with a speed of 35.86 tflops. or the virginia tech which is no. 3 which contains 1100 Apple G5 systems. with a speed of 10.28tfps. though i dont really have plans to achieve teraflops speed but i believe if i have the knowledge of simulating 2 computers to act as 1 is enough to solve my daily task.
Viewing 3 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply