It's the teachers
Even boys; a truly dreadful teacher destroyed any early interest I had in in maths and number play, and I never did catch up. I was still smart enough to work around that on my own (NB: still with dismal marks) and had a 30 year career in engineering after I retired from the military, without a degree nor even any engineering coursework; THIS boy read dictionaries and encyclopedias (and a lot of other books, too) for enjoyment -- and played with with electromagnets.
https://www.wisconsinmedicalsociety.org/professional/savant-syndrome/resources/articles/hyperlexia-reading-precociousness-or-savant-skill/