Hungary's prime minister sparked a public outcry after he criticised Western Europeans for "mixing with non-Europeans".