So you don't think it should have been used to desegregate our country? How about to end slavery? That was a government decision certainly not one made by the slave owners.The problem with AA, and so many other statist programs, is that it embraces the notion that government is an appropriate tool to (as rightwinger put it) "implement" society - that it's a useful tool to force societal changes on the unwilling. And it's just not.
Of course the government should prohibit slavery. It should have never accepted the practice in the first place. That is a question of actual, individual rights.
Government has a responsibility to treat everyone equally. No one else does.