I'm not sure, but I had thought that the execution context for the Agent job mattered, and as Agent jobs run under the auspices of the Agent Service's service account, that account would have to have the rights.   You really shouldn't need to add explicit permissions to do something like this, but I suspect you would need to have the account that the Agent Job service runs under have the necessary permissions.   Any experts who know for sure, please correct me.