Victorian Health Minister Martin Foley says "Victorians should consider if they want to go to NSW" and for Victorians in outer parts of Greater Sydney to come back.