Many factors come into play, it is not just the number of rows.
How the data is being queried, indexes, etc. play a part.
You need to see and understand what is causing your struggles today.
If money is no object, you can always throw more hardware at it.
But I haven't seen too many places where that is a good answer.