Try GUI:

Go to SSMS, Right Click the DB, Properties,

=> FILES==> see which file is under your filegroup;

=> Filegroups=> You can remove the filegroup from here.