Many properties have been declared 'illegal' because owners were forced to build without an impossible-to-get permit.