Why Save the Marriage? Why Not Just Be with the Other Person?

Often the betrayed spouse asks the question, “If my  husband/wife loves the other person, then why save the marriage?  Why don’t they just leave and go be with the affair partner?