Do you think the term "lynch mob" has a racial overtone?

I was wearing a Lynch Mob (the band) T-Shirt when this black dude griped at me for wearing a racist shirt. I called him a dumb azzz and informed him that anyone can be lynched by a mob. It has nothing to do with race....