Miller's comments were condemned by Republican and Democratic colleagues, as well as the U.S. Holocaust Memorial Museum