West Bengal chief minister Mamata Banerjee on Wednesday took out an anti-CAA rally in the industrial town of Durgapur in West Burdwan district.