Re: Pimp or madam?
Ultimately it adds the bias of human classifiers to AI models. For American, white, females, pimp may ne classified as negative but American, black, males might classify it as positive.
AI machine learning can do no more than determine what stereotypes exist in its source material. Whether the stereotypes are good or bad, valid or invalid, is not something machine learning can address.