Situated on Bennelong Point in Sydney Harbour , close to the Sydney Harbour Bridge , the facility is adjacent to the Sydney central business district and the Royal Botanic Gardens , between Sydney and Farm Coves .