I'd expect the restore time to generally be longer; if restoring to a new database, potentially significantly longer.

For a backup, SQL only needs to backup the active portion of the log. When restoring, SQL needs to restore the entire log, and also ultimately roll forward and/or roll back in-flight transactions to make the final db useable.