I would not say you are a racist. However, it does strike me as odd that one can be totally "not into" a whole race! Black guys come in all shapes, sizes, skin tones, ehtnicity, etc...
To reject them ALL based on race does seem a little, er, over-selective. And your protestations of how "they" get mad when you won't give in to them, well, it doesn't sound good.
In the interest of full disclosure, let me say that I wish to hell I lived there!