Two fishermen have died after being swept off rocks at a notorious fishing spot in the NSW Illawarra region, where three men drowned just weeks ago.