Re: Quis custodiet ipsos custodes
How is that different from human learning?
With humans it is possible to consciously correct for the biases, on many levels - starting with self-adjusting the datasets we train on, disregarding certain inputs we judge to be irrelevant, continuing to trying to rationalize or disprove the intuitive conclusions by building mental models of the situation, and on to passing our reactions through the filters of legal and socially-acceptable behaviours. With all of it going on in parallel with a bit of self-reflection and empathy.
In contrast, "AI" decisions at this point tend to be the equivalent of an emotional response from an infant - certainly indicative of the inputs in some potentially useful if roundabout way, but not necessary a sensible thing to take on trust.