Personally, I believe that if you value your relationship, you would want to be happy and experience some sense of sanity and calm in it. It would not make any sense then, for you to separate your own happiness from the relationship, because, let’s face it, you are in it to be happier and fulfilled.
However, this does not mean you should be selfish, try to weigh your options and put yourself in perspective, before taking any decision. Instead of giving up something totally, try to do it in a way that it doesn’t affect the two of you. You need to stop acting like there’s a gun to your head, even if there is.