Multi-Node Training No progress on Azure

### System Info

```Shell
accelerate_Version: 0.12.0,
OS: Ubuntu18.04,
python version:3.8
torch version: 1.11.0
accelerate config: Root node(0) - {
"compute_environment": "LOCAL_MACHINE",
"deepspeed_config": {},
"distributed_type": "MULTI_GPU",
"downcast_bf16": false,
"fsdp_config": {},
"machine_rank": 0,
"main_process_ip": "20.169.144.69",
"main_process_port": 46585,
"main_training_function": "main",
"mixed_precision": "no",
"num_machines": 2,
"num_processes": 4,
"rdzv_backend": "static",
"use_cpu": false
}
Node 1:{
"compute_environment": "LOCAL_MACHINE",
"deepspeed_config": {},
"distributed_type": "MULTI_GPU",
"downcast_bf16": false,
"fsdp_config": {},
"machine_rank": 1,
"main_process_ip": "20.169.144.69",
"main_process_port": 51731,
"main_training_function": "main",
"mixed_precision": "no",
"num_machines": 2,
"num_processes": 4,
"rdzv_backend": "static",
"use_cpu": false
}
```

### Information

- [ ] The official example scripts
- [X] My own modified scripts

### Tasks

- [ ] One of the scripts in the examples/ folder of Accelerate or an officially supported `no_trainer` script in the `examples` folder of the `transformers` repo (such as `run_no_trainer_glue.py`)
- [ ] My own task or dataset (give details below)

### Reproduction

Use two azure VMs for multi-node training

### Expected behavior

```Shell
The expected behaviour was that both machine start training and either communticate with each to sync or provide an error if that fails but the training did not proceed on either of the nodes. Tried using NCC_DEBUG=INFO to check for network issues but did not get any prompts. Not sure what I could be missing here as I followed the items mentioned in previous issues which were closed for multi-node such as https://github.com/huggingface/accelerate/issues/609 and https://github.com/huggingface/accelerate/issues/412
```