The issue is that it IS science. It's backed by good quality research, even if you prefer some other supposedly better research.
If your good quality research is contradicted by other good quality research, you're not doing science. Ahem.
That said, no matter how good the science is, it doesn't support Damore's own conclusion that discrimination doesn't exist.