West Ham United boss Sam Allardyce was annoyed at his side's defending during the 3-1 defeat to Stoke City.