Your Md must be young.
If allergies simply got better as you get older, mine would be gone. The truth is some go away and some pop up new. I'm a senior and I followed my 95-y-o mom's allergies for many years too. It doesnt matter if it's food or pollens; you can become immune or get new ones. I just got allergic to grass this year. I acquired an allergy to sunflower seed from feeding birds for over 40 years. People who work in some of these industries, like sunflower seed, often become allergic. People in Japan often become allergic or sensitive to rice.
I lost my ability to tolerate lactose when I was in my 40s. But Lactaid milk is a staple in my diet because I'm allergic to pork, can't digest beef, allergic to soy, some nuts. I only tolerate one brand of yogurt, Activia, and that in small amounts.
I think I would go with the allergist and drop the nature doc, even if she is an MD. She needs more experience with real people. It was fun being a hippy when I was young, briefly. We made our own bread, grew our produce in the backyard of our row house, sewed our own clothes. Then we grew up.