Sometimes pain is the only symptom of gall bladder disease. I know of people who went to the doctor for this odd pain in their side and find out their gall bladder is full of stones. From just what I have observed, stones don't seem to cause quite as many symptoms as outright dysfunction, because a stoney gall bladder will keep on functioning to some degree a lot of times. When it's dysfunctional you tend to have more episodes of nausea, vomiting, indigestion, diarrhea, etc. But, like I said, sometimes pain is the only symptom. Fever is actually not a symptom of a bad gall bladder, but I think it frequently is when your appendix is bad.
Yep, probably time to get proded anyways.