The man accused of punching and kicking a soccer referee in the head after a Friday night match in Sydney is refused bail.