Re: An interesting problem.
How can you even be sure that there is or is not information in the AI which is relevant to an individual? And even more worryingly how can you be certain that you fake data does not create relationships which seem to identify individuals. After all, if the data is realistic then it must mimic reality.
On another note, some 20 years ago when I was writing HMRC's personal review system they were using real data for test purposes. I thought this was a no no and so used some name generators I and a colleague had written for some simulations.
Being a bit fed up at the time I didn't use the English language names.
Some samples follow:
Brictius filius Æson
Galenus filius Artemidorus
Rogatus filius Luciferus
Antipater filius Alcinder
Isocrates filius Clophas
Bratislav Radovladov
Budig Gostomyslov
Rogovlad Vyshemirov
Chestimir Ostromirov
Perei Velislavov
Gradimir Izjaslavov
Volodimer Radimirov
Vladimir Miodragov
Samovlad Yarovidov
Sobeslav Svyatoslavov
Lyutomir Naislavov
Gorica Yasnomyslov
Sveinbiǫrn Þorvarðrsson
Gunnarr Þorfinnrsson
Ásbiǫrn Óleifrsson
Ásbiǫrn Ǫnundrsson
Hólmsteinn Oddrsson
Finnr Hrólfrsson
Ǫrnólfr Álfrsson
Oddr Geirmundrsson
Eysteinn Þorvaldrsson
Arnórr Eilífrsson
Ingialdr Steinólfrsson
Bárðr Kárisson
Watching the attempts at pronunciation was fun.