In my personal opinion, yes, there is a difference.
Anxiety disorder sufferers do not have 'panic attacks', they have 'anxiety attacks' where they become extremely anxious in various situations, or may feel just mildly anxious all the time.
Panic Disorder can vary with it's extremeties. Some people just suffer with a few panic attacks here and there, and not have many other problems and can deal with it with breathing techniques and CBT, and then there are the more extreme cases like myself, where I feel like I'm in constant panic mode most of the day, and have a panic attack every day or even sometimes twice a day.
I am now on meds though, and the panicky feelings have subsided from the day to day basis, to just sometimes getting panicky and having a panic attack at least once a week.
It sounds to me like you have panic disorder, rather than GAD (generalized anxiety disorder).
There are approximately 19.1 million Americans that suffer from Anxiety Disorder, whereas only 2.4 million Americans are sufferers of Panic Disorder. Amazing eh?
"Be glad of life because it gives you the chance to love and to work and to play and to look up at the stars."
DX: Panic Disorder, Depression, TMJ (Temporomandibular Joint Disorder), Chronic Migraines
RX: Ativan/Lorazapam (1 MG a day), Lexapro (15 MG a day), Tylonel for the TMJ and Migraines