Prince Harry will not return home for Prince Philip's memorial service and has been accused of snubbing the Queen.