Taking the "wait-and-see" approach may be the ticket for you. If you had gallstones it would be a slightly different story, as stones can move into your bile duct and then emergency surgery would be required. With a low ejection fraction, it's not like you have to have it out yesterday; the likelihood of facing emergency cholecystectomy (the medical term for gallbladder removal) is low.
I think Keri's advice is sound. Since there's no rush for surgery, maybe try different approaches to see if you can minimize your symptoms without going under the knife. Surgery has a LOT of risks on its own and if you can possibly avoid it I would try to!