Mansfield residents are backing a popular busker after he was issued a 24-hour ban from the town centre.