Tara, what you are describing is very similar to my situation.
I was diagnosed with GERD/gastritis in early March after an endoscopy (found no ulcer, just some inflammation in the stomach and duodenum) and was on Aciphex between March and May for a total of 2 months.
In early May, I stopped taking Aciphex due to my concerns about their side effects. After about 3-4 days, I started to feel the effects of what people may describe as rebound. It wasn't horrible (just slight warm sensation in the stomach after about 2-3 hours after eating.) I got over the initial rebound and was doing good. My stomach didn't feel perfect but was still manageable and I thought I was doing ok.
Starting about two weeks ago (so about 2 months after quitting), I started to feel a stronger sensation in my stomach. I tried to manage it with Pepcid AC and Pepto Bismol but on Friday, I just got tired of the pain and went back on Aciphex. The burning sensation is also around my belly button and slightly lower sometimes. It usually happens about 2 hours after eating. After going back on Aciphex, the burning sensation has subsided somewhat. I am scheduled to visit my GI in another week to discuss this.