One of the other issues for using this in places, let's say a loan app, is that as humans, we produce data from past results. Those are often based on inconsistent choices for some, and deliberate prejudices. We are all prejudiced, and some don't know it, but the ML algorithms reveal some of this when they act on the data.

Like children, the systems learn based on the inputs and our feedback of whether things are moving in the right direction or not. That means we're teaching them to behave as we do, with our leanings on certain subjects.