Re: Its the camera, stupid.
I'd expect exactly the same reaction from my neighbor if I attached a camera to a long pole and used that to look at his yard. (Maybe not exactly the same reaction -- not all Americans shoot stuff on sight.)(Also, not all of them think that everyone's a perv after their kids.) You have to use a bit of common sense when you're flying these things.
Given my neighbor's size and temperament it's very likely that such a pole would wind up rather uncomfortably lodged in the lower anatomy or the original pole holder, camera and all. Given that, the drone pilot should consider himself lucky.