It seems to me that if you have to lie about it that's an indication that you are likely mismatched with your partner.

Personally--there's only been one woman. I've known her for 20 years (although the first months of this were not romantic), we've been married for 17.