Excellent observations and I heartily agree. Great point on even the data elements to be included or excluded in consideration. I think this points out exactly the root problem of artificial intelligence, that it is in fact artificial. The points about factors to be considered regarding financial aspects of life are a perfect example.
Various developers from differing backgrounds. life experience, and motivations will use differing criteria for data analysis which by default introduces biases into the decision making. Maybe the saving grace in all of this is that the bias has always been there, and AI just makes it easier and faster. This applies to so many areas of life such as financial, political, and social settings.
This gives a whole new meaning to GIGO. It all depends on who hauls the garbage.
One of the best days of my IT career was the day I told my boss if the problem was so simple he should go fix it himself.