An Aboriginal man is suing the Federal Government for more than $4 million after he was unlawfully held in immigration detention for 500 days.