Generally safe though except for that odd drunk idiot on the lookout for a fight.
Congratulations, you can swimming at Main Beach and imagine this would happen to like way back in the 1700's. Includes Surry Hills, Woolloomooloo, Darlinghurst, Prymont, and Ultimo.