the inequalities could be caused by racial discrimination (bring born in a black household, you're more likely to have issues than a white household, statistically). Inequalities could also be caused by other factors, unrelated to racism.
The tests measure certain cognitive capabilities. Genes have an effect, nutrient intake has an effect, nurture has an effect. Trying to fix racism via test scores (or disregarding it) isn't going to help fix racism.
To be blunt. You can look at life expectancy for black and white americicans. Whites live longer. Measuring the difference is not systemic racism. We should not avoid measurements for this reasons.
Some minorities perform worse on SAT. This is a fact. SAT predicts performance in college, this is also a fact.
The question becomes, how do we select college students. Those most likely to succeed, or other values.
They don't measure human potential at Birth and don't try to.