Rob Lowe has joked his Montecito neighbourhood is “never going to be the same” after the Duke and Duchess of Sussex moved in.