Like Squeesax, I love military uniforms to death, but wearing them outside of cons/re-enactments/house is NOT a good idea.
In my opinion, I don't think it's okay to wear a fully detailed, 100% accurate uniform at a con. Especially with a swastika. If you do that, you're begging to get beat up. On the Hetalia note, since their uniforms aren't that accurate, I believe it's okay. (As long as the Anime Boston 2010 incident doesn't happen again!)
That's my take on the situation, so.... *flies away*