The comedian has become known as "the castle slagger" after popping in at a number of UK castles and passing comment.