Sounds like the almond flour is your main culprit at the moment. Alot of us make that mistake... we're virtually addicted to baked goodies so when we get on the SCD, we go crazy with the almond flour and it's too much, too soon.
I also think the diet has to be tweaked for individual food reactions. I could never tolerate the wonderful homemade yogurt that's such a huge part of the diet. I tried everything before concluding I just couldn't handle any kind of dairy. I also had to eliminate all but very small amounts of cheese.
It's a frustrating process, but it's going to take time for you to figure out which allowable foods are your "safe" foods. Once you have a base of safe foods to work from, then you can start slowly adding in the allowables that can be more difficult to digest like almond flour, raw veggies and beans. For me, the safe foods are tender white meat of chicken or turkey - baked, grilled or broiled, scrambled eggs, soft cooked green beans and carrots, soft cooked winter and summer squashes. Baked pears and apples and very ripe bananas. Fruits and veggies need to be peeled. Nut butters are easier to digest than whole nuts. Supplementing with healthy oils - Udo's, fish, flax and olive will help you feel less hungry.
For some reason, I never did well on the recommended beginning diet. Too much red meat, though allowable, seems to disagree with me and some folks have reactions to eggs. Figure out what works for you and avoid your personal problem foods. Keeping a daily food journal can be a big help in tracking reactions.