Because that's what unfaithfulness is, isn't it? A cancer that's always there in the back of your mind, eating away at the foundations of the relationship.
Unfaithfulness is the fire extinguisher of love.