Although she publicly said she is “entirely supportive” of Prince Harry and Meghan Markle’s decision to leave royal life, privately the Queen – who puts duty before everything — would find such a choice unimaginable in her own life.

“The Queen will be very disappointed,” royal historian Robert Lacey tells PEOPLE. “Her job is to survive” — and to ensure that the monarch survives.