Any other process runs at that time ?

How many records are fetched from oracle approx. ?

What about linked server settings ? Check the security tab in linked server properties and see the credentials used to connect to oracle.