Use robocopy for transferring the backup files... Cant really comments on time taken to transfer... depends on your network speed

If you can use a compressed backup , even better...

Try breaking backup into multiple files instead of one big file..