Terraform - OpenStack "The server timed out waiting for the request"

 I used terraform script to create instances on OpenStack Train. The OpenStack cloud is located on a remote data center. Due to the high network latency issue, the terraform script failed with the below error.

[2021-01-12T11:49:22.938Z] * openstack_compute_instance_v2.ac[0]: 1 error(s) occurred: [2021-01-12T11:49:22.938Z] [2021-01-12T11:49:22.938Z] * openstack_compute_instance_v2.ac.0: Error waiting for instance (f9ce3fd0-3673-4a6e-92c5-5d51a8f65add) to become ready: The server timed out waiting for the request

Solution:

Increase the rpc_response timeout value from 60 to 300 for nova, cinder and neutron. This will avoid the "server time out waiting for the request" error

[root@controller-0 ~]# grep -i rpc_response /var/lib/config-data/puppet-generated/nova/etc/nova/nova.conf
#rpc_response_timeout=60
rpc_response_timeout=300

[root@controller-0 ~]# grep -i rpc_response_timeout /var/lib/config-data/puppet-generated/cinder/etc/cinder/cinder.conf
#rpc_response_timeout = 60
rpc_response_timeout=300

[root@controller-0 ~]# grep -i rpc_response_timeout /var/lib/config-data/puppet-generated/neutron/etc/neutron/neutron.conf 

#rpc_response_timeout = 60
rpc_response_timeout=300

Then restart the nova, cinder and neutron service.

For HA controller setup, Follow the above steps on all three controller nodes.