Foreign Minister Datuk Saifuddin Abdullah says the government is considering to allow refugees access to public schools, hospitals and the workforce.