I remember more the "I'll be back" line from when I first watched it, because of the carnage that immediately follows that scene. However, I watched the "EDITED FOR TELEVISION" version, so I think that the "Fuck you, asshole" line may have been cut out back then... *and* I was like 5 years old.
Hm... I wonder why "Mr. Sulu, Warp Speed" isn't one of those quotes. My dad used to use that line when entering the highway, which usually meant we'd grab on to anything as he would speed up to 160+ km/h. Ow.
As for Goldfinger's "I expect you to DIE, Mr. Bond!", it really sounds like the most badass line ever given by a Bond villain. Right to the point: I don't want you to talk, or fight, or whatever. I want you to die! bahahahahaha!!! Note that 007 had *no* means of escape, it is only because of his bluff that he is able to save his arse. Oops!