A little boy says he was "so scared" when a man unlocked the gate into the front yard and grabbed him.