I'm not sure I would necessarily think of chronic fatigue initially in your case. While symptoms of fatigue may come and go in the early stages, this is probably unlikely. When it reaches the point where symptoms are as you describe, then it would be considered "chronic" and wouldn't ease as you've also noted.
Unfortunately, CFIDS is extraordinarily difficult to diagnose, and really requires a physician familiar with the condition to observe the patient, as well as interpret key blood tests.
I completely understand being fed up with doctors. Before I was diagnosed, I saw nearly 20 doctors, crossed two state lines, and put thousands of miles on my car. I was clueless, and so were they. All it seems that they want to do is shuffle patients in and out of their doors with a Band-Aid prescription in their hands, or expensive tests on order.
While I wouldn't necessarily rule out CFIDS completely, I'd maintain an open mind about other conditions as well. Don't give up!