If it isn't the primary file group you could try this with a test version of the database:

Create a new file group, move all the existing objects from the old file group to the new file group, then drop the old file group.