Why do some group of people behave as vermin but cannot see why they were perceived as such?

You could say the same thing about whites and being racist. Don't let a few rotton apples spoil your opinion about a whole bunch.