Scores of families were left homeless when a mid afternoon fire swept through the Kampung Hidayat squatter settlement in Tawau, Sabah on Saturday.