Given biased training data, do we not want the AI to be equally biased?
Ie, with the doctor / nurse example. If the majority of training examples refer to doctors in the masculine and nurses in the feminine, assuming the training set is reasonably representative of real input, the likelihood is that this is precisely the translation the majority of users want / expect. The fact that the training data is biased, simply implies the end user is likely equally biased. If the AI were to deliberately choose to remove this bias, this is getting worryingly close to the machines attempting to impose their will on us... and I can see nothing but madness down that road.