You will need to issue a shrink file against the files in the file group, after they are empty you can then drop them and the filegroup.

Andrew