The Queen's two eldest children were already in Scotland, where the monarch died at her beloved Balmoral Castle.