Ben Fogle has sparked a debate after appearing on Good Morning Britain and saying he wants the speed limit changed in his village.