Nope,
In high school i actually did a tribute to various anime characters for my GCSE general artwork. got a good grade for it and the teachers thought it was very diverse. Some of my mates enjoy animestill, others don't really care what i watch, its just a given thing now-a-days, they talk about football and i just sit listening, i talk about anime and they just wait till i'm finished.
My gf and my best mate take the p*** sometimes, saying i "need to stop watching cartoons" but i know them well enough to know that their only messing around.
If you enjoy anime, keep at it, no matter what people may say.