Two vice chairs of the Conservative party say they are quitting after Brexit negotiator David Davis and Foreign Secretary Boris Johnson both resigned for the same reason.