The issue is amazon isn't recieving a confirmation from HA-Bridge before the time out of Alexa.
You can play with the settings in HA-Bridge to try to speed up confirmation sends and improve this, however there is no way to change this time out on the Amazon side.
Network speed and congestion can also affect this.