Steven Mnuchin said on Friday that he didn't consider resigning over President Trump's Charlottesville remarks.