I keep my config file on the same server as the packages run on though I store those packages in msdb.

The account that is defined in the sql agent jobstep to run the package must have permissions to access the config file directory.