After hosting the weekly specialty stalls for decades the prime waterfront site will become a car park, at least temporarily