Scandal fans don't really appreciate that his character is trying to steal Olivia Pope away from the President.