Simon Cowell

Simon Cowell has been accused of adultery in his friend Andrew Silverman's divorce from Lauren Silverman, with whom The X Factor judge is expecting a babyTMZ reports.

Photos: Celebrities who've survived scandals

Andrew has listed adultery in his divorce papers, which were filed in New York, according to the site. In the filing, Andrew goes so far as to accuse his wife of "inhuman treatment," saying: "The nature of this action is: to dissolve the marriage between the parties based upon (1) the commission of acts of adultery by the defendant [Lauren] and (2) defendant's cruel and inhuman treatment of the plaintiff [Andrew]."

Andrew also seeks sole custody of the couple's 7-year-old son.

According to the initial pregnancy report, a source told Us Weekly that "Lauren and Andrew were unhappy in their marriage for some time, and their divorce has been in the works for a while. As their marriage deteriorated, she and Simon became close."