Some say they have been targeted by political activists, conservative groups and anti-vaccination campaigners who have united around common goals.