103 sounds too high a temperature to be related to inflammation alone. Over the last few months, I've been getting raised temperatures in the evening sometimes, anything from 37.3 to 38C (not sure offhand what that is in F, sorry >_<). I don't get them every night and I'm not sure what's different about the nights that I do get them except that in general I feel worse; more bloating, discomfort, pain, etc.
I consider the temps I'm getting now to be low-grade, but 103 definitely isn't low-grade. Sounds like your doctor could do with taking it more seriously, but then again I'm not sure how often they're happening - 7 times in two years, for example, wouldn't be very much, but 7 times in two weeks would be.