When it comes to relationships, I have seen that we are afraid to confront our spouses because we all want to avoid loneliness. Adam joined Eve's decision so he wouldn't have to be alone. Spouses put up with a lot of bad behavior so we can avoid being alone, it is one of life's most powerful influences. The best way I know to combat this is with personal consistency. Keep asking yourself:
When you are being true to who you want to be, you tend to be less reactive to the other person and more responsive to what God is trying to do in your life. Certainly not easy but I have seen it to be effective.