living in a big European city, dealing all the immigrants is naturally very stressful to me. but this can be attributed to the fact that they hassle me every time i take the subway or the fact that they are more likely to be violent/criminal. but ever since i was a small child, before i had even started judging people based on their skin color, i was always unhappy being around non-white kids.
Sounds like you've been externalising your misery for a long time.