Maybe the difficulty with women is that they are prone to wearing makeup and changing their appearance quite frequently. The ability to accurately map the various facial features decreases if the image lacks sufficient contrast - which is more likely with dark skin than light skin.