As long as SQL is down when you do this and your databases end up on drives of the same letter when you restart, this will work. (I have done it).

Just back everything up first

Alter database won't be required in this scenario.