I need an intelligent system to do some data crossing. The amount of data is very big and it is stored on MSSQL. All the records from different servers should be compared and linked if similarities are found, based on different criterias.
My question would be, which is the best way, based on performance, to do this and what tools should be used? Maybe NoSQL structures to store all the data? And what algorithms may provide the most adequate results?
Every solution/idea would be greatly appreciated !
Thank you !