"To insinuate that I would do anything to harm my daughter is just sad man," Ray J said on Instagram on Thursday