It's your data, so you have a responsibility to look after it.
That means keeping a log of EVERY website that you give that data to.
Every site you register your email address with, and your address for a delivery.
If you are prepared to do this, then part of the solution is simple. Its up to you to remove the information from sites that you no longer use. (If they let you) If they don't let you delete your account, then change it so that the information is valid, but irrelevant.
change your home address details. change the password to be something very tricky and different to everything else, change any mobile phone number you submitted to them to be something else (random) then change your email address and name.
Their big data gets very invalid very quickly, but it's ultimately your responsibility to badger companies that don't let you delete your own information until they get rid of it, or you make it invalid data that no longer applies to you.
Yeah, I'm paranoid about this sort of thing. and no, I don't do it all yet, but I'm on the way to getting this sort of thing all setup and separating things that really don't relate to me as a Physical Person (things like tumblr,youtube,twitter,el reg), to things that have to be tied to me, like credit cards, electricity bills and bank accounts.