Prince Andrew has been stripped of his Freedom of the City of York honour following a vote by councillors.