After little bit of 'googling',I could successfully connect to my ODBC

1.)Exec sp_addlinkedserver

EXEC sp_addlinkedserver

@server = 'MY_ODBC_SERVER',

@srvproduct = '',

@provider = 'MSDASQL',

@datasrc = 'QFTest' //System DSN

GO

2.)To check whether SP worked,

EXEC sp_tables_ex @table_server = 'MY_ODBC_SERVER'

3.)I could successfully retrieve all the data from the table 'BTL'

SELECT * FROM OPENQUERY(MY_ODBC_SERVER, 'SELECT * FROM BTL')