In a recent interview, Paula Abdul told Barbara Walters that Simon Cowell often bothers her just before show time, whispering in her ear and saying things to unnerve her.

“It’s never done with any maliciousness,” Simon Cowell told reporters in response to Abdul’s complaint. “I’ve done it from day one,” he admitted. “That’s part of the relationship I’ve had with Paula.”

But don’t worry that there might be trouble brewing with the American Idol judges. “She’s never really had an issue with me about it,” he explained. “If I thought I’ve gone too far, I’ve apologized.”

Cowell doesn’t just limit these attentions to Abdul, either. “I do it to all the judges I work with on all the shows all over the world.”