The owner of the house where the three women were held captive has been charged, but so far his brothers have not been implicated.