Wes Bergmann asked his Challenge costar to leave the house they were staying at after she made racially insensitive remarks