IOC president Thomas Bach has revealed some athletes were critical over his decision to postpone the Olympics