Nobody cares because CRIMINALS.
It seems to me that Congress-critters and their ilk don't see any problems with this sort of privacy violation because the only people it truly affects is miscreants and other never-do-wells. Joe Blakes like you and I have nothing to fear, because generally nobody has any reason to want to search us out in the first place.
That the occasional savvy stalker might abuse such a system seems to be the cracked egg price of facilitating "legitimate access" on the part of those who need it to do their jobs.