Thus far, I've had the best luck using the XCopy client. It's a bare minimum, but make SURE you read the documentation before trying to load it. We need it for linked server connections to various Oracle RDBMSes and install only the OLEDB provider.

(As a side note, this is also the client my fellow DBA, an Oracle DBA, recommended, so it's got that going for it)