I was able to track down the cause of the replication job disappearing. The development team was dropping and recreating the database from a previous backup that did not have the replication switch applied. This caused a mess with Replications.

However, I did modify the system stored procedure in our dev environment to log who done it.