That is correct, you cannot drop the first created (primary) data or log file . If you want to move this you will incur some minimal downtime.
Create your alter database ... modify file statement and run it. Then perform the following
-----------------------------------------------------------------------------------------------------------
"Ya can't make an omelette without breaking just a few eggs" 😉