Pep Guardiola was left frustrated with the referee after failing to show James Milner a second yellow card.