"Well they think that you have a lot of plastic surgery growing up on TV," the Don't Be Tardy star said of viewers who question her appearance