The FAA is investigating after a small plane went down near the Palmyra Airport in Jefferson County, Wisconsin Sunday.