fix gh-4786. I chekc all LocalOptGroup and in2out and out2in and those 2 optimizations are the only one I think need apply_all_opts=True.