FedML-AI / FedML-AI/FedML

One server and one client example in FedCV object detection

Open
#399 13 comments 0 reactions 2 assignees Claimed by @yyyanbj View on GitHub
help wanted question research-projects
Dominant language
Python
Stars
4.1k
Forks
765
PR merge metrics
No merged PRs in 30d

Description

Hi,

I build FedML platform using docker container provided by the authors.
To see the performance of simple one server and one client example, I run `run_server.sh` and `run_client.sh` scripts inside the object_detection/ directory. Then, I started receiving following state in server and client terminal

#Server side:

```
mqtt_s3.send_message: msg topic = fedml_yolov5_0_2
mqtt_s3.send_message: msg topic = fedml_yolov5_0_2
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:249:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_server_manager.py:101:handle_messag_connection_ready] Connection ready for client2
Connection ready for client2
Connection ready for client2
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:140:on_connected] mqtt_s3.on_connect: server subscribes
mqtt_s3.on_connect: server subscribes
mqtt_s3.on_connect: server subscribes
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 5
mqtt_s3.notify: msg type = 5
mqtt_s3.notify: msg type = 5
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [server_manager.py:155:receive_message] receive_message. rank_id = 0, msg_type = 5.
receive_message. rank_id = 0, msg_type = 5.
receive_message. rank_id = 0, msg_type = 5.
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_server_manager.py:111:handle_message_client_status_update] self.client_online_mapping = {'1': True}
self.client_online_mapping = {'1': True}
self.client_online_mapping = {'1': True}
[FedML-Server(0) @device-id-0] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_server_manager.py:126:handle_message_client_status_update] sender_id = 1, all_client_is_online = False
sender_id = 1, all_client_is_online = False
sender_id = 1, all_client_is_online = False

```

#Client side

```
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 17, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 17, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 17, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:33:03] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 19, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 19, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 19, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:34:04] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 21, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 21, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 21, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:35:05] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 23, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 23, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 23, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:36:06] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [fedml_client_master_manager.py:62:handle_message_connection_ready] Connection is ready!
Connection is ready!
Connection is ready!
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:148:on_connected] mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 25, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 25, result = 0
mqtt_s3.on_connect: client subscribes real_topic = fedml_yolov5_0_1, mid = 25, result = 0
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:198:_on_message_impl] mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
mqtt_s3.on_message: not use s3 pack
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:172:_notify] mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
mqtt_s3.notify: msg type = 6
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [fedml_client_master_manager.py:162:send_client_status] send_client_status
send_client_status
send_client_status
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [client_manager.py:157:send_message] Sending message (type 5) to server
Sending message (type 5) to server
Sending message (type 5) to server
[FedML-Client(1) @device-id-1] [Thu, 21 Jul 2022 02:37:07] [INFO] [mqtt_s3_multi_clients_comm_manager.py:277:send_message] mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent
mqtt_s3.send_message: MQTT msg sent

```

I suspect that there is some problem in the connection between client and server.
I am using the same PC for client and for server
Any hint and suggestion is highly appreciated !!!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.