Are they stats (show up in sys.stats) or are they indexes (show up in sys.indexes)? What's the exact statement you're running and the exact error you're getting?

btw, if you drop an index, the stats associated with that index are dropped along with it.