The Road of Remembrance is the main road linking the town to the seaside, residents say the diversion route is leading to congestion and disruption.