Seems pretty obvious
If you reduce resolution to "what cell tower are you connected to?" you narrow down where everyone lives within a range of a single cell tower by seeing where their phone typically spends the night. You can further reduce them to "where they live and where they work" pairs by seeing where their phone typically spends weekdays.
With those two steps alone given those two data points you can probably narrow down most to a few dozen candidates, some already to a single candidate. Add a third location for hours aside from home/work, like their favorite pub, their girlfriend's address, their favorite fishing hole or whatever and you can probably narrow down to a single candidate in the majority of cases with only three known cell tower locations!
Now add tracking for others who live with you, like your wife and her place of work, your kids and where they go to school, etc. and any family is probably super easy to identify. Good thing the cellular companies don't provide cell tower location information to the NSA to save forever.