Lyrica and other drugs in its class often lose effectiveness after several years and when this happens, you may experience symptoms of withdrawal as it is no longer working properly. According to Wikipedia, one of these symptoms is anxiety/panic. I don't know what the maximum dose is, but I would discuss this with your doctor if you think the drug might be causing this and see if increaseing the dosage is possible. Also, never stop this drug abruptly...it has to be tapered.
Not saying this is the reason for your problems but it's a possibilty!