Pakatan Harapan leaders want Tan Sri Pandikar Amin Mulia to relinquish his post as Dewan Rakyat speaker if he is no longer able to focus on implementing reforms in Parliament.