The Tokyo Games should be held next year for the 'benefit of the athletes', Japan's Olympic Minister has said.