Hundreds of refugees on Manus Island continue to insist they are unsafe among the general population of the island, claiming they are often attacked by young drunk men.