Yes, you'll be fragmenting the indexes which will require you to rebuild them all (which will grow the file again)
Gail Shaw
Microsoft Certified Master: SQL Server, MVP, M.Sc (Comp Sci)
SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability