It could be any number of things. Your best bet is to look at the error log and the execution log of your mirroring operation in SQL Agent. There's no way for me to suggest an answer without more data.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning