Prince Charles paid a secret visit to Joan Washington before her death, according to her husband Richard E Grant.