I think you've just discovered why smart switches are better than smart bulbs. If you don't absolutely need color, a regular dimmable LED bulb + smart dimmer switch will be your best bet. I switched out all the switches in my apartment when I was just renting. and just switched them back when I moved out.