Yep. There's no easy answers really.

Just out of curiosity, why are you using a partitioned view instead of a partitioned table with a partition scheme and function? I find that SQL Server does a little bit better of a job creating predictable query plans with the latter than the former.