In addition to taking a log backup and looking into why the log is that large,  I would also want to look at the number of VLFs as that can impact the recovery time.
If you want to be certain on what phase of the restore is taking the most time, you can set a trace flags for verbose logging of the restore prior to doing the restore:
DBCC TRACEON(3004, 3605, -1)

Sue