"The prime minister took us all for fools" and "showed himself unfit for office", said opposition leader Keir Starmer