Feeds

back to article IQ test: 'Artificial intelligence system as smart as a four year-old'

Researchers at the University of Illinois at Chicago have applied an IQ test to MIT's ConceptNet 4 artificial intelligence system, and determined it's about as smart as a somewhat-challenged four-year-old child. The team used the Weschsler Preschool and Primary Scale of Intelligence Test on the system and found it performed …

COMMENTS

This topic is closed for new posts.
Gold badge
Thumb Up

"common sense"

Remarkably uncommon.

Man has it taken a long time to get even this far.

So LISP was what 1963? 50 yrs to get to 4.

How long to get to say, 20?

Thumbs up for the progress but there's a lot me thinking "meh."

5
0
Silver badge

Re: "common sense"

What it's revealing is how little we understand of what 'intelligence' really is (let alone 'consciousness'). There's a famous story of an AI researcher from the 'golden years' (Donald Michie?) setting a doctoral candidate a summer task of developing robotic vision, thinking that it was a relatively easy problem. 50 years later, we have ANPR, but facial recognition remains pretty hit or miss. Progress is being made in restricted specialised areas, such as autonomous cars, but I think it will be decades at least before there's an AI capable of sustaining an intelligent conversation (though, again, one could say the same of many humans).

4
0
Silver badge
Thumb Up

Re: "common sense"

So LISP was what 1963? 50 yrs to get to 4.

And how long did it take for the human race to evolve beyond knuckle-dragging...? About a hundred thousand years or so?

I've been quite harsh on "AI" stories here in the past because they were almost all "faster recipe crunching" or "bloody great database search" stories. It's good to see some are still trying (and some are still evaluating) AI in the real conceptual and intelligence realm. It's a bloody difficult problem, and getting to 4 in 50 years is an amazing accomplishment.

7
1
Silver badge

Re: "common sense"

getting to 4 in 50 years is an amazing accomplishment.

They didn't get it to the level of a 4 year old child. The got it to the same level as the test would indicate. Not to put the developers down, but this could also be taken as a test of the IQ test.

0
0
Bronze badge

Re: "common sense"

The IQ test was developed by the french to identify which children needed more support at school. The author of the original test didn't think you could sum up intelligence with a single number and actually considered that the test was only useful comparing children with similar backgrounds.

Despite the tweaks to the test since, personally I think a better test of intelligence is asking peoples perception of the worth of the test across the entire population against people with radically different ages.

I personally consider people with a high opinion of the test (knowing it's history and methodology) to be remarkably unintelligent.

1
0

Unfair

I think it's unfair to expect an AI to have common sense, considering most people don't have it either.

28
0

Common Sense is a mental simulation of a given situation

Nobody has perfect common sense, but people have a lot more common sense than any Artificial Intelligence program. Common sense in't a 1 or a 0 kind of thing. It's a matter of degree. Which means that Common Sense is analog and not digital.

To be able to answer the questions of 'Why?' about anything you need to have working mental models of people, things, and nature in your mind. Because to be able to answer, 'Why does ice feel cold for a person?', you need to have a working model of ice where you can mentally simulate ice touching various things and people and cooling them through physical contact.

Just remembering facts doesn't help you much to answer the question of 'Why?', because to answer such a question you need to create a mental simulation of the situation you are being asked about and observe what happens in this simulation, so that you can explain what's going on, which is the answer to 'Why?'.

Your ability to create mental simulations of various situations depends a lot on how sophisticated your metal models of various things and people are. That's why children's answers to the question of 'Why?' are a lot less explanatory than are such answers from adults. The mental models that children have are a lot simpler.

Perhaps modern computers are still too slow and have too little memory to be able to have working models of everything and be able to create computer simulations of various situations at the drop of a hat, the way people do mentally. But quantum computers might be able to do something like this in the future.

0
0
Bronze badge

I am not trying to criticise the work, which I know nothing about...

...but is this not in truth a computer-based software system developed specifically to approximate and imitate a narrow range of intelligent behaviour? If I am not mistaken, the thing is not self-aware. It is therefore an experiment in cutting-edge, clever programming but there's no real intelligence, merely pre-programmed responses, and it is certainly not at the level of a 4 year old child in reality. Of course I may be wrong. If so please set me right.

2
1
Anonymous Coward

Re: I am not trying to criticise the work, which I know nothing about...

@ Anomalous Cowshed

I think the idea is simply to benchmark how far they have reached. It may be 'clever programming' etc. and 'no real intelligence' but there's a lot to be learnt by attacking the problem in that way. For example, they now know (and perhaps this was obvious to them or perhaps not) that the 'why' problems are the hard ones. So a future version might be hybrid: use the current technology for the 'what' and 'where' type questions which are factual and knowledge-based and working reasonably well; and work on something new and better or different for the 'why' questions. But at least they know where to focus their efforts.

2
0
Bronze badge

Re: I am not trying to criticise the work, which I know nothing about...

Raise a child and one learns how hard it is with why questions.

4
0
Silver badge

Re: I am not trying to criticise the work, which I know nothing about...

What does self-awareness even mean? I mean my computer "knows" it exists.

0
0
Bronze badge

Re: I am not trying to criticise the work, which I know nothing about...

If you've ever had the opportunity to observe it in real life, the transition between mechanical response and self-awareness is amazing. If your computer achieved this state, you would be justified in kneeling before it and welcoming it as your new overlord.

0
0
Thumb Up

Re: I am not trying to criticise the work, which I know nothing about...

"...but is this not in truth a computer-based software system developed specifically to approximate and imitate a narrow range of intelligent behaviour? "

I think we are talking about something a bit more complex than ELIZA here. Very impressive in my opinion. The problem seems to be with giving an AI the right background parametres. To program a 4 year old would appear to take about 4 years of streaming data to it...

2
0

Re: I am not trying to criticise the work, which I know nothing about...

The problem is we are a hybrid of autonomic and "intelligent" systems, the difficulty is our lack of understanding where one ends and the other begins.

Added to that exactly how each of them works.

0
0
Pint

My kids got past that stage

total slobs nowadays;

1
0
Anonymous Coward

half way there ...

IQ test: 'Artificial intelligence system as smart as a four year-old' ..

Next step is to mate it with an animatronic head and Fox News, here we come ..

6
1
Silver badge

Re: half way there ...

" Next step is to mate it with an animatronic head and Fox News, here we come .. "

Network execs at FOX will never go for that. A four year old mentality, even a slow one, is still too high for their demographic audience target!

5
1
Silver badge
Happy

Re: half way there ...

DJ-3000 - http://vimeo.com/18516240

0
0

"... as smart as a somewhat-challenged four-year-old child."

Still smarter than most Politicians, then...

3
0
Bronze badge

Re: "... as smart as a somewhat-challenged four-year-old child."

Or my users...

6
0
Bronze badge

Re: "... as smart as a somewhat-challenged four-year-old child."

Bother! You beat me to it. :)

0
0
Anonymous Coward

Re: "... as smart as a somewhat-challenged four-year-old child."

which says more about you than your users

0
2
Silver badge

Start with lower goals

AI does not have to replicate human intelligence to be useful. Just being able to replicate the intelligence of a beetle would be a damn good start.

A few months back I spent many minutes trying, and eventually succeeding, to kill a fly. A fly's ability to navigate and evade danger, find food etc are quite remarkable. Being able to achieve that level of AI in a robot would lift the game considerably.

2
0
Silver badge

Re: Start with lower goals

"A fly's ability to navigate and evade danger, find food etc are quite remarkable."

Ah, but is the fly remarkable, or is it able to evade you so well because its 2GHz clocking speed far outstrips your 90MHz clock? To a fly we are lumbering slow-motion jackasses. We only get them effectively when we learn how they fly and aim there rather than at the fly itself, and even then the fly can evade if it notices in time.

As for food...it's a fly. Everything is food.

3
0

Re: Start with lower goals

A lot of a Flys evasion is physics not processing it tend to get pushed out the way by all the air we move tring to hit it. that is why fly swats are full of holes, also they are tough little buggers.

0
0
Silver badge

Re: Start with lower goals

This is how to kill a fly WITH YOUR BARE HANDS!!!

1. wait for the fly to land somewhere convenient

2. put your hand in "ready to flick" mode (index finger bent with nail against pad of thumb)

3. slowly slide your hand along the surface that the fly is sitting on until the fly is just within range

4. FLICK

5. go squish the fly which is now lying stunned on the floor a couple of metres away.

0
0
Bronze badge

"it's about as smart as a somewhat-challenged four-year-old child. "

Ready to take over management functions.

16
0
Silver badge
Terminator

its a 4 yr old

SKYNET!!!!!!

Kill it now before it escapes into the wild and deems us humans its enemies

Boris

<<looking for a 40w phased plasma rifle

1
0
Bronze badge
Terminator

Re: its a 4 yr old

Then SKYNET is only a teenager... eventually it will get through the rebellious stage, settle down and... oh, dear!

2
0
Bronze badge

Re: its a 4 yr old

Then SKYNET is only a teenager...

It gets worse after their gap year. They're never the same after they've seen attack ships on fire off the shoulder of Orion or watched c-beams glitter in the dark near the Tannhäuser Gate.

2
0
Bronze badge
Facepalm

Artificial Intelligence

This gets lots of attention, theses, papers and grants. Not much talked about, though, is that no one can get money to study artificial stupidity, probably because we have too much of the natural kind already, organic -- and smelling of it.

But that's something that REALLY needs a cure.

2
0

Wonderful news. It's already as smart as George Bush.

9
0

Hmmm

Time to overhaul the laws, in anticipation for sentient AIs. Might as well prepare for the possibility of them becoming full citizens at some point in the future, and have the reasonings worked out in advance of how we are going to do this, then have to deal with it when our attention might be diverted elsewhere.

0
0
Silver badge

I'm just wondering

How they can prove that it was their program doing the responding, and not, say, five thousand randomly selected internet users?

0
0
Anonymous Coward

AI? Where's the cooking, cleaning, bed-making Bot I was promised as a kid?

Instead the MSM bombards us on a daily basis with promises of 'Terminator' class technological self-awareness on the horizon. Ray Kurzweil et al, would you please STFU! Just give me a boring domestic bot! I want an easier life!!!

1
0
Joke

"Such systems are have great difficulty generating what humans call common sense"

Is it smart enough to become a Reg proof reader is the question?

0
0

Rival solution

while (true) {

hands.becomeSticky();

hands.touch(items.getAllNearby());

nose.dribble();

voice.yell("Are we there yet?", Volume.MAXIMUM);

}

3
0

At least they've got past the terrible twos and all those tantrums.

0
0
Terminator

already too smart

No common sense, and know a lot of facts? It is already smarter then most politicians, CEO, executive management...

This is the raise of skynet, stop it now.

0
0

I think AI will reach its potential when the soccer robots fall over after a collision, grab their ankle and roll around on the ground. We will then know that it has reached the intelligence of a Division 1 soccer player, which is probably around the 10 year old mark.

2
0
This topic is closed for new posts.