I couldn't agree more, it would be nice to clean up some of these things.

Personally I would leave REPLACE alone and add a PATREPLACE.

I would also like to see CHARINDEX/PATINDEX changed to have an occurrence parameter, eg find the 2nd occurence of char in string starting from character 10.

On ISNUMERIC, Grant Saunders recently posted a nice little workaround for it.