don't see what the transvestism/stick he no doubt gets for it has to do with it really. I dont' think people dressing in cardigans (at least before they became trendy a few years back) exactly get in easy at night in town centres either...his comedy is excessively cutesy in the most part, i think he counts - it's the way he talks about things. he's responsible more than anyone (possibly not that far, but he's a factor) for the prevalence of twee facebook updates about muffins and tea and jam.
I dont' see for the life of me that he's more twee than B&S, except if we're explicitly taking twee=cardigans, rather than twee=an attitude that makes things unnecessarily cutesy and removed from the real world.
anyways, doesn't really matter if he is or not because, as you rightly point out, i hate him and his effect upon popular culture. And that is the important thing.