Ashford residents fear there will be no open space left if plans to designate a plot of land as a village green are turned down.