I am also off of prednisone, today is day 6, and at the end of the tapering I also started to get terrible pains in my feet and my hands and sholders. If i sat to long like more then 5 minutes i could barely get up and walk, i am walking around like i am 90, its terrible, i can barely go up and down stairs, it hurts to change my clothes etc.
After doing some research I have found that this is normal, for most people who take Prednisone. Prednisone mimics Cushings syndrome, and people who have cushings also have the same kind of pain. Right now i am taking pain killers for arthritis, and that seems to help, but they do bother my stomach, so i would look into that before you take them.
Also, apparently the body aches and pains take a few months to go away after stoping the prednisone, im hoping it happens sooner than later, good luck!