Congress leaders in Kerala expressed concern about participating in the Ram Temple inauguration ceremony