A man described as "dirty and ragged" allegedly dragged a teenage girl to the ground at a family-friendly park.