Two men were seen looking into the grounds of the school attended by the Duke and Duchess of Sussex’s children.