The Victorian Premier says he understands people are eager to see restrictions ease but insists the decision will be guided by health advice.