The assembly is loaded into the database. The DLL is no longer used -- and can even be deleted.

You are correct, there can be many issues, and it is not an easy task. Not so bad for functions and stored procedures most of the time, but quite interesting for user-defined types...