If you attribute the dangers in your community, not to the individual Hispanics that are making the community dangerous but to the Hispanics in general then that's a pretty racist attitude. Arming yourself or moving to another neighborhood is of course, irrelevant to the question of being a racist. It's not what you are doing but rather the reason you are doing it.If I live in a neighborhood that slowly becomes more dangerous to live in over time, and the neighbors moving in are mostly, lets say, hispanic, and I'm white, am I racist for either arming myself against danger, or by moving to another neighborhood?
To put it another way, if you are moving out of the neighborhood because Hispanics have made the neighborhood dangerous, that's racist because you are attributing the danger to all Hispanics. However, if you're moving out of a Hispanic neighborhood because several houses occupied by Hispanic gangbusters are making the neighborhood dangerous, then that's not racist.
Except of course it is not really on option for anyone to check the records of each and every household that moves in.