First of all if you have a large system and that table is queried a lot you would get a TON of emails.

I don't know if there is a way to do what you want to do.

Maybe you should go about it in another way. Generate a list of all userids that have select, insert, update, delete to that specific table (remember data_reader and data_writer get access to all tables in the db as well) and take that list to the data owner and have them tell you if everyone on that list should have access. If not, remove them.