Are you rebuilding the index? A rebuild should result in reduced fragmentation.
BTW, if you're not experiencing lots of scans, it's possible that you don't need to worry that much about fragmentation. If you're primarily getting point lookups on your data, fragmentation has minimal impact.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning