From changing trends to bankruptcies to global pandemics, a variety of forces have conspired against these ice cream and fro-yo chains.