Sorry mate, but (honestly) not meant as a joke, but genuinely interested. Think it would be a shame, if your marriage was destroyed over something like that. From my stance (I know it's probably a guy's thing), it's something that should be able to get over and done with.
It's not like you betrayed here with another woman and got caught doing so.