Re: A happy AI
"There are machines that are bigger than us, stronger than us, faster than us, can lift heavier objects than us and can spill better than us. We don't feel threatened by them, so why should a machine that can think better than us be different (unless it, itself, comes up with a really good reason: but we probably wouldn't understand it)."
Think about it this way: a smart fighter can defeat a strong fighter because he compensates for general weakness by being able to maximize the impact of his strikes. But now, imagine if the strong fighter was smart as well. Now you have a deadly combination.
Furthermore, intelligence can be leveraged to create a virtuous cycle. A super-intelligent AI able to perceive the world in some way would be able to digest these perceptions and grow even smarter, which would then allow it to better learn and so on. Being strong doesn't necessarily lead to increasing strength because you need to KNOW how to get stronger, but with intelligence, the knowledge comes with the territory.