Whitstable is the eighth most popular town in the UK for second-home owners, and locals say it's driving them to move out.