"I knew I would get caught eventually, and I think I wanted to get caught. ... It was me trying to self-sabotage my life," James says during his Nightline interview, which airs Tuesday, May 25 at 11:35/10:35c. on ABC. "It's hard for me to talk about it a little bit because I still really love her and care for her."
James, 41, also said he's aware just how much damage his actions have caused his Oscar-winning wife.
"I've spent my whole life with the kids and with her trying to protect her from everything, but the most hurt she's ever been caused is by the person that wanted to protect her," he says. "It's terrible, and she's going to be hurt for a long time."