Re: Wait! What? They have our MAC Addresses?
Incorrect. IP != MAC, end of. Unless it's done out of band there is no way they're getting MAC of source / return.
Run wireshark and take a look for yourself, note all traffic to / from your gateway will have a source / dest MAC corresponding to your GW HWADDR / MAC.