Bombshell allegations mean one royal in particular will be looking for reasons not to meet Prince Harry