Does the account/ SQL Server agent Service account has delete file permission on the server where job is set up?

Try logging in the folder with the account which is running the log shipping job and see if you are able to delete the file manually?