You need to enable your agents for logging and see what error is logged.
Use this kb article to see what the failure is.
When the agent fails you may also want to run profiler to see what is causing the problem.
http://support.microsoft.com/kb/312292
SQL Database Recovery Expert 🙂