Not really, I know enough people that do this that it doesn't really affect me either way. In fact certain male characters I expect it, like how many Len's do you see that are actually guys? Not a lot.
I've known couples where the boyfriend got bent out of shape about it, but mainly that's an image thing. I mean I've also seen couples where both of them are crossplaying, like a cloud / yuffie pair a while back.