James Middleton honoured the marriage of the late Queen Elizabeth and Prince Philip instead of "celebrating" his own wedding anniversary.