A British referee has criticised the Pakistani security forces after they "vanished" during the attack on the Sri Lankan cricket team.