I frankly think wearing 2 sports bras for an entire day does more damage!
Well no damage really but it HURT!!!
My personal experience, I've had no problem. The only thing that can really go wrong is if you bind too tightly and have trouble breathing.
Otherwise, like other people have stated before this: a weekend's worth of binding really shouldn't be a problem.