Prince William reportedly felt that the former Prince Andrew was an "ignoramus" and urged King Charles to banish him from the royal family years before action was taken.