A NSW court has rejected claims by a former high profile mayor and homelessness advocate that he was too old and sick to face a retrial on historical child sex abuse charges.