That is one for testing per your environment as either could produce the best result.
I would do a test without the primary key, insert the data, create the primary key and time it.
Then truncate the table and import the data again.
That way you have a time it takes to import and create the key VS time it takes to import with the key existing, then you can make an informed choice.