I'm surprised nobody's yet mentioned HMRC.
Business records, not unreasonably, will include personal information such as the billing address on an invoice.
HMRC says "Thou shalt keep all this information for seven years."
Customer says "Delete this information now".
So who wins that one?