The speakers motivations be what they may, you indicating verbally your disapproval of this behavior will make other people who are also uncomfortable/hurt/offended more comfortable knowing that someone else in the group is a human being who cares about the effects their words have on others.