If you have a relational databae then you need to have FK constraints, without them you may as well look at column database.

The FK can impact perfromance, however they can also be used by the Query Optimizer for optimizing queries.