Simon Cowell Simon Cowell

Simon Cowell has never been one to stay silent, but for once The X Factor judge is watching his words. Cowell evaded questions at the Television Critics Association on Thursdayregarding the news that he impregnated his friend Andrew Silverman's wife Lauren.

He later explained to People that this is a matter he'd like to keep private for now. "There are a lot of things I will eventually clear up when the time is right, but I really have to be sensitive because there's a lot of people's feelings involved here," Cowell said.

Photos: Celebrities who've survived scandals

Andrew released a statement

 the same day, explaining: "My top priority is protecting my 7-year-old son while working to resolve all outstanding issues with my wife. Hopefully people can respect the interest of our child during this process."In a separate statement, Lauren added: "I am committed to sorting things out with Andrew as amicably as possible to ensure the well-being of our son. I would hope for some space and privacy in order to work through this."On Thursday, Andrew filed divorce papers in New York citing adultery. He also seeks sole custody of the couple's 7-year-old son.