Unless you want to fight everybody, yes.Tell them to F off and go about your business. I hear Antisemitic remarks frequently. It doesn’t bother me.
But you notice, right? And you do nothing? Keep your head down and move on?
Bingo. Racist remarks are par for the course when you are in a melting pot.