Andy Cohen fell victim to a fraudster who scammed him out of "a lot of money" by pretending to be from his bank.