I guess the question I would be asking myself if I were you, would be, is my anxiety causing my bowel issues, or are my bowel issues causing (or at least contributing to) my anxiety ?
Since our gut controls so many things, including our emotional well being, that is where I would start looking.
Eating a balanced diet is an important start, but finding the RIGHT balanced diet is imperative ! have you tried eliminating any foods completely for any length of time ? do you have someone to cook for you or are you on your own ? since dairy can be a problem for many people, that is where I would start. And try to completely rid it from your diet, not just reduce.
Another thing to keep in mind, is if you eliminate something, be careful of replacing it with something that may present it's own set of problems. I.E., milk substitutes like soy, rice, almond, etc. Many of them contain ingredients that can cause problems. Carrageenan is one problematic ingredient that comes to mind.
Hope you find some answers.