A few facts:
1.Yes, there is a male brain and a female brain.
Examples:

-Men have 10% larger brains on average
-Women have a higher % of grey matter
-During emotional memory processing, men have greater activation in the right amygdala, while women have greater activation in the left amygdala
-Women have greater cortical thickness
-Men have a higher serotonin synthesis rate
-Women have higher neuronal density in language-processing regions
-Women have higher orbitalfrontal to amygdala ratio
-During resting states, men show stronger functional connectivity in motor and sensory networks while women show stronger functional connectivity in social and emotional networks
-INAH-3 is 2-3x larger in men than women
-BNST is 50% larger in men

2.No, the fact the brain is a mosaic does not matter. People like to talk about the fact that individually these structures are really just group averages and the brain is a mosaic of male and female structures, but when you look at the brain as a whole it really does cleanly fall into male and female brains. We know this because a stanford study trained an AI on resting-state fMRI scans of roughly 1,500 people, and it maintained over 90% accuracy in predicting sex across multiple independent datasets from different research centers. Now some may think that 10% inaccuracy means something but in reality, it just shows the limits of AI and it could have been pushed further with different methods or given more training data