My wife and I have god-kids with autism that makes Rain Man look normal. As a result of working with them (to give their mum a rest twice a week) for the last 14 years and getting more and more interested in the topic, she's become quite a highly trained special needs teacher and works with all kinds of people on the autism spectrum (Aspergers being a severe sub-set of autism)
Once you get to know the kids and what works for them, you get to understand that they're actually pretty cool behind the walls. If you apply normal rules of society on them you'll get nowhere. They're all different in their triggers and interactions so a post-it smiley will work for some, but not others. You have to tailor your interactions to the individual.
According to her, my dad and I are both "on the spectrum" but not so far that you'd notice without prolonged interaction.
I just wish teachers for normals had the same level of attention to borderline cases like me and my dad as my wife does to her "specials". We were both written off at school as difficult, intractable, stubborn etc and went on to graduate with honors from McGill in Mining Engineering. Once we were exposed to our "thing" and not forced into doing stuff we hated (Shakespeare in particular and anything not physics or engineering or maths) then we really pulled ahead of the crowd.
As for the haters, AS is much much more common than you think. Just about everyone has it and it's not "jumping on the bandwagon" or "being cool". It's just not a big deal for 90% of cases. Not like my god-kids.