People who buy automotive racing jackets do so knowing they don't drive for the team and others who see them with one know that too, but put a racing team jersey on a cyclist and people think they are a make believe racer. It's weird that way. I don't like wearing racing gear or some sort of clothing advertising anything, be it autos, something to do with bicycles, etc., because I don't like the billboard effect, nor want to advertise for some company that I had to pay for the shirt to do so, usually in advertising they pay you to display their stuff not the other way around. This is why if I buy a used car and the dealer has put on their dealer plate bracket with their logo I go home and take it off; dealer decals are a pain, I have to heat the decal with hair blower and then try to slowly take the decal off, then afterwards use Goo Gone and get the glue residue off, then wash the area and buff with wax.
I hear you though, it's not hurting anyone. I don't know how old you are but back in the late 70's when all those cowboy movies came out everyone wanted to dress like a cowboy even though they were so far removed from living on a farm their genes cried foul, we use to call those guys drugstore cowboys because they were fake cowboys, it's the same thing with the "I want to look like a racer", they're not so I call them drugstore racers.