The original benefits of so called expert systems was that it was claimed they could take a series of relatively simple questions and lead through a decision tree without getting side tracked or missing out important branching conditions. The tree was loaded with verified stop <> go branch choices with each the result of exhaustive study, rather than the wet finger loved by some 'experts'.
The article does make this locked, sealed box sound more like a GiGo box, (garbage in garbage out). I did a study back in the late 1960s, this conclusively showed that factors then considered too difficult to quantify and thus termed constants, were (a) variable and (b) had far greater effects on the results than items that were studied and researched at great expense, 'the dependant variables'.
Humans do come with some preprogramming to carry out the sort of social studies of other humans done by this magic trick box, so I am not surprised they scored pretty much as well. I think this one might need a trip back to the study room and I am surprised the call has not come sooner.