Re: a sufficiently motivated person could in fact find out exactly how I voted.
Yes- but given your used ballot paper, searching though the marked-up electoral rolls is an onerous task; likewise given the rolls (and hence you ballot paper number), searching though a giant pile of ballots for yours is also onerous.
It is about as onerous as running the electoral rolls and ballot papers through a scanner, followed by OCR and full-text search. Certainly something a single private individual of average means would be able to either do herself, or pay for.
So, in fact not onerous at all - and I would be very surprised if this is not already done as a matter of course by some obscure government department. Because terrorists.