That's probably a bit of jealousy, I don't buy into this rule of thinking if I like it I don't really care what anyone thinks.
To be honest can't see to many young men driving them as there quite expensive compared to say something like a Fiesta ST.
I personally love yellow but went for blue due to the wife, I've only seen one other in a year and that was a middle aged women in my local Tesco and I spoke with her and she said it was her husbands car.
Get one you won't be disappointed, I believe it's the best fun car that Audi make at present.