Leaving a relationship isn't necessarily a simple option, and if you get something from both your regular partner and the one with whom you are cheating there's a clear benefit to playing both sides.
Of course there's always the chance it will come at a much higher cost but I guess that's the risk cheaters are willing to take.