The Home Affairs Minister says her department accidentally sent letters to refugees and asylum seekers, telling them to leave the country.