Or, if you need/want more support some companies make bras that are meant to be hidden under a halter top.
On the cheaper end, those "convertible" bras can usually be worn with one strap going around the neck - so it wouldn't show at all.
Check out this picture of a fancy one
for an idea.
A non-bulky halter-shape bathing suit top could work, too.