I experienced that when I first began smoking again. I had to stop for three months because they triggered panic attacks(since they're a stimulant), but now I can handle it. I still can't get anywhere near caffeine, though.
I feel like I can't breath or that I am getting really sick when I am smoking every once in a while, and when it happens, I merely put the cigarette out and re-light it later when I think I can handle it. I like to smoke, because I enjoy the buzz(naturally lol) but I by no means need it, and I don't get cravings for it, so its easy for me to just put it out.
I suppose in the end it will just be a choice you will have to make on your own, but remember it's not worth panicking over.
Good luck and God Bless :)