I set the account that the SQL Server Agent ran as to my Account and it worked.

I set it to the Domain SQL ServerAgent Account, grant it local admin and sysadmin and it fails.

I changed it back to SQLServerAgent and now it works.