Seaside town once popular with backpackers, now seeing residents forced out because of rising costs and construction.