Outgoing Singapore Prime Minister Lee Hsien Loong will remain in the cabinet as Senior Minister after stepping down as leader of the government on May 15.