Without seeing what you see, can't really tell you. What I can say is that rebuilding indexes does not eliminate fragmentation, it reduces it.