Good Morning and hugs to you. I know it is extremely difficult to live with a spouse that has depression.
I am the depressed spouse in our family and I remember my husband getting frustrated and even saying one time he did not know how much more of the situation he could stand. That was at the lowest spot in my depression. He was really just worried about me and felt helpless.
I did get to a therapist and went through many med changes for nearly a year before I finally ended up on one that works but it does not make me feel happy, just able to live in the real world again. I never had a sudden uplifting from the meds.
I have tried talking with my PCP and Pdoc about trying it without the meds and my pdoc said I would crash and burn. I have Depression and the hardest part was excepting that.
There is a lot of stigma with the mental health disorders. I understand you do not want to be yelled at but remember he is sick and it sound like he does want to get well but he is having a hard time accepting that he has depression.
Try not to get pulled into any heated discussions with him. If he yells at you please tell him " when you yell at me I feel upset" Don't accuse him of making you upset. Just explain to him how you feel.
I think it is a positive sign that he is going back on his meds.
I do understand where you are coming from and I know you have to do what you choose.
I support you and please know I care.