I've never had any trouble of a serious nature...
Was once on a train from meadowhall, when I was 15, going through Barnsley, loaded up with shopping, and some skinheads got on, really pissed up, and the first thing they said, really loud, to me and my friend, was "no p*kis on here" but nothing actually happened, except police got called by the conductor, cos one of them spewed on the train, and they got took off at Barnsley.
More recently in Manchester I was hanging around with a bunch of kids who put gigs on and lived in an art squat and they were trans, couple of them wearing lots of make up, and certain parts of Manchester, like even the northern quarter, there were some looks, snidey comments as you walk past.
But no overt violence that I saw anyway.
I tend to keep my head down out and about, always have done. And my hair wasn't really long til I was in my 20s.