Narendra Modi visited Sree Padmanabhaswamy Temple on Thursday and called on members of the erstwhile royal family of Travancore.