Vanity Fair reported Thursday that President Trump has "mulled" removing the White House Chief of Staff position.