A source previously told PEOPLE that Kanye West and Kim Kardashian went to the Dominican Republic to "focus on their marriage"
