BBC - The Last Enemy (2008)
We're almost there, but with even less accountability... Happy days!
Commercial AI is great at recognising the gender of white men, but not so good at doing the same job for black women. That's the conclusion of a new study, "Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification", that compared gender classifiers developed by Microsoft, IBM, and Chinese startup …
Surely it's absolutely not racist since the one thing it can't do is discriminate?
It is not the computer's fault to start off with. Basic photography 101. With the same exposure levels for a colour photograph you will get less contrast and less feature differentiation for darker skin colours.
If you want to make the computer job easy, change the spectrum band in which you take pictures. I suspect that you can get significantly lower error rate going into near IR. This is already being done for number plates by the way.
Well, this is my first thought, poorer contrast. But it is an assumption. Even with a balanced training set tuning of parameters is often already done first on a separate set, so it could be at that stage too (and coming back the the contrast/IR issue, evaluation against other methods is often on smaller sets before being applied to larger ones, so the need for an appropriate imaging method can get missed).
Surely it's absolutely not racist since the one thing it can't do is discriminate?
That's a bit like saying that there's no problem with racial minorities being shot by police, because guns can't see skin color.
Computer software can't help but reflect the biases present in the data sets it's trained with (AI), or validated against (manually coded algorithms.) One of the dangers here is that computers will become a way to codify bias in a socially acceptable, plausibly deniable way. "It's not me, it's the computer."
"We now have racist computer systems. When will it end!"
On the bright side, we are, even here in the 21st century, still seeing regular news stories of black people being stopped and searched or assumed to be up to no good by white police officers. If the facial recognition is so much more poor with darker skins, then mainly white "persons of interest" will get flagged up by facial recog.
If the facial recognition is so much more poor with darker skins, then mainly white "persons of interest" will get flagged up by facial recog.
That depends on whether the failures are false positives or false negatives. It could be the software will decide all black people look suspiciously like its database of perps.
"Rwanda, Senegal, South Africa, Iceland, Finland, Sweden"
There seem to be a few areas of the world with relatively distinctive features missing...
I wouldn't call it representative if there are no or very few people from the Indian subcontinent or east Asia, not to mention South America.
Not only that but "individuals
from three African countries (Rwanda, Senegal, South Africa) and three European countries (Iceland, Finland, Sweden) selected for gender parity in the national parliaments"
The authors are so blinded by their desire to find a bias on gender and skin colour that they've picked a test dataset that is massively skewed on ethnicity, age, health and social class.
They also tie themselves in knots trying to reconcile biological gender with gender identity, so their benchmark gender classification is suspect in the first place (it's based on Mr, Mrs and the "appearance of the photo").
Agreed. To be representative you really need to sample everywhere. Otherwise there are always going to be big gaps in its applicability domain. In this case Scandinavia is over represented, so it's going to be over trained on Vikings, while they've got just three really distant countries representing all of Africa.
The word "Intersectional" is the giveaway. A study declaring itself Marxist/Leninist would have identified that the discrepancy was class based and constituted oppression of the proletariat using exactly the same data and for exactly the same reasons (confirmation bias).
That doesn't mean they are wrong about the differential accuracy of course. It just means they have pointlessly poisoned the well regarding the integrity of the study.
A) Rwanda, Senegal, South Africa - three very distinct and different black race subtypes.
B) Iceland, Finland, Sweden - same Caucasian subtype across the board
How about trying an equally diverse Caucasian set. Let's say: Sweden, France and Bulgaria (*).
(*)I know I am being mean to the poor AI - Bulgarians vary from a nordic sand blond to outright Mongoloid nearly Genghis Khan look alike. However, officially - they are all Caucasian.
Many times it has been stated, there is more diversity and difference inside groups than there is between groups. So while we notice the differences of vast distant populations, we ignore through confirmation bias or social normality, the massive differences locally.
"I wouldn't call it representative if there are no or very few people from the Indian subcontinent or east Asia, not to mention South America."
Beat me to it. Between them China and India cover over a third of the world's population. It looks more as though they deliberately took the extremes of some of the whitest and blackest populations they could find. Which is fair enough for a certain kind of testing, but can hardly be considered representative and is likely to paint things in a particularly bad light.
Many times it has been stated, there is more diversity and difference inside groups than there is between groups.
That may be true for genotypes (it's actually an oversimplification), but it doesn't hold for phenotypes, particularly not when you're only considering a tiny subset of phenotypical data which the human brain has specifically evolved to evaluate (faces).
Isn't 85% of all genetic diversity in humans found in Sub Sahara Africa (phenotype as well)? Remembering hearing that. Too lazy to get real reference but this wikipedia snippet will do for now.
"Sub-Saharan Africa has the most human genetic diversity and the same has been shown to hold true for phenotypic diversity. Phenotype is connected to genotype through gene expression. Genetic diversity decreases smoothly with migratory distance from that region, which many scientists believe to be the origin of modern humans, and that decrease is mirrored by a decrease in phenotypic variation. Skull measurements are an example of a physical attribute whose within-population variation decreases with distance from Africa."
Isn't 85% of all genetic diversity in humans found in Sub Sahara Africa (phenotype as well)?
Most of the genome has no external phenotypical expression and whole-genome genetic distance does not necessarily correlate with phenotype as the variation in dog breeds and the quasi-canine appearance of hyaenas illustrates. Conversely, sub-saharan Africans and aboriginal Australasians have the greatest genetic distance but are often considered to be phenotypically similar.
Sub-saharan Africans do not have any Neanderthal or Denisovan genetic contribution (3-5% in everyone else) besides some rare instances of genetic backflow from the Levant. This impacts externally observable phenotype, particularly in terms of eye and probably hair colouration (plus the immune system, hair texture, respiratory metabolism and a number of other areas).
Human perceptions of phenotype are evolved to assess ingroup membership rather than genetic distance per se. That means the environmental (in human terms, cultural) aspect of phenotype is often of greater importance. For a human, how an individual dresses and behaves (e.g. a military uniform, prayer rituals) is part of the phenotype just as the exact design of a nest is for a bird.
A lot of genetic variation can arise within hybrids of two different species.
It seems it happened in Sub Saharan Affie as well as in Europe, only with an older more primitive humanoid :
Looks like Europe and Asia were subjected to high selectivity, because only a bit of the variation derived from Neanderthal / Denisovan mixing has survived
"B) Iceland, Finland, Sweden - same Caucasian subtype across the board"
If linguistic patterns dating back a long long long time - several thousand years at a minimum - are a clue, Finns and Swedes are very different groups... one would expect the Finns are more closely related to Siberians than Scandinavians.
"The Out of Africa theory is controversial. As of today, the evidence for modern HS originating there is just the age of the oldest HS fossils"
AFAIK, the only part of OoA that is controversial is the number and timings of the migrations.
A recent study showed that a second wave of OoA migration is sufficient to explain the replacement of the Neanderthals in Europe with Homo sap.
And yes, you are right, there seems to be absolutely no evidence for humans or protohumans in Europe before the OoA migrations.
So was the correlation purely on darker skin tone as such, or was it actually caused by a correlation between darker skin tone and different facial characteristics that react less well to the identifying parameters used by the algo?
I suppose I could read the article, but that's too much of my time.
Biting the hand that feeds IT © 1998–2018