Options
You know what would have made this work without the problems? A bloody option.
Instead of all this "machine learning"/AI rubbish that everything seems to be labelled with these days how about trusting the user to determine what they want?
If a site starts playing audio immediately show a message with "let this site do this" and "stop the noise now and forever" type options and let the user determine if they want the auto-play or not.
And do the same for video whilst at it.