"When I was younger, I really didn't think about the impact of not having my dad in the house," Porsha Williams said on Sunday's episode
