The actress and country musician, who is slated to perform at Thursday's ceremony, last attended the awards show as a pair in 2019
