Jim Carter, the Downton actor, on the only man to have struck a six over the Pavilion, and why there's just one window in the Media Centre