Stopgaps
Let's face it, as nice as it sounds, very, very few developers code specifically to maximize processor performance. That's a big part of the reason why processors have had to keep making such performance leaps.
There are two primary reasons for this lack of performance based coding:
1) it's often cheaper (and faster) to write sloppy code and just add lots of processors
2) There is a profound lack of tools and education designed specifically for performance coding, especially concerning multi-core processors.
RapidMind and the Google tools are nice, but nowhere near what is needed to maximize multi-core processing. As multi core proliferates the first player to the game with true development tools to natively support several cores will make a fortune.