The former Victorian Premier said the Kew MP must ask himself whether he is becoming a liability to the Liberal Party.