Observatory Hill is a secluded place, with any small park from which you can observe purchase on the Sydney Harbour Bridge zooming by.
The Children's Hospital is option one. The park was opened in 1912 and has been often refurbished.