Latest departure is another setback for a prime minister who came to power promising more accountability in politics.