FYI disabling the programs did not improve cm19a performance
Some of the standard installed programs on HG are making a lot of web calls to the server and as a result the Pi Zero W really isn't suitable for this type of application when you add other factors into the equation.
Possibly stripping HG back to the X10 basics and along with the CM11 or the CM15 you'd probably get away with it.
My own recommendation would be a Raspberry Pi 3b or 3b+ which would more than cover your needs and allow you to run your system comfortably with a CM19 too. That's roughly what my setup consists of.
You could always repurpose your Pi Zero W as a standalone HA Bridge server or there's plenty of other Pi projects out there that would comfortably interface with HG too.