Federal Territories Minister Khalid Abdul Samad on Tuesday said calls to ban products sold by non-Muslims will only destroy the unity of Malaysia.