The ex-UK foreign minister is under fire from across the political spectrum after saying Muslim women who wear the burka look like "letter boxes" and "bank robbers".