If you can use third-party solutions, check the commercial CozyRoc Receive Mail Task. It supports both POP3 and IMAP for connecting to mail server.

---
SSIS Tasks Components Scripts Services | http://www.cozyroc.com/