Ballast Point occupies the northern point of Mort Bay off the suburb of Balmain. It is just a hop, step and a jump to Goat Island. Andrew has the information about the previous use of the point.
Located on the harbour as it is, it is understandable that rapacious developers wanted to get their greedy hands on it. However, it was spared for the people and industrial landscapers were let loose upon it. It is a confronting park from the water. But I will stay judgement until I have walked around it. It would be accessible by taking a ferry to the Thames Street wharf, walking around the Mort Dry Dock and entering from the bow of the park.