While the crowd cheered for the athletes, jeers and whistles erupted as Vance and his wife appeared