Silly question, but why so many indexes?

In some cases, you have NameAddr1, NameAddr2, NameAddr3, NameAddr4, WorkAddr1, 2, 3, 4 etc.

So how often do your queries look for a specific value in NameAddr4?

I get the impression you have an single column index covering just about every column in your table.

Exactly how many of these are actively used for you searches?

Point being if you thin out the number of indexes and possibly consolidate some that better fit the queries (e.g covering indexes, indexes with included columns), you may have a quicker index rebuild task.