That's certainly true, but it also depends upon the cap/hat. I never wore the white monstrosity that's part of the current QF uniform, and took some delight handing it back, still in it's wrapping. Looks terrible, and simply didn't fit (anyone).
And the argument goes the other way too. Aprons...