Welcome to Healing Well, I am Kitt.
Many of the AD's may slow your metabolism and make you more hungry. You can control your appetite and you can control your metabolism. It just takes some work.
You can start by taking better care of your self in general, exercising (join a gym), eating well, making sure you get enough sleep. Your exercise program should include cardiovascular and strength training. It is recommended that you exercise for a minimum of 45 minutes, 3 X per week. 5 X per week would be even better.
Giving up the med may dump you back into the merry-go-round of Anxiety and Depression.