apache / apache/cloudstack

Deleted KVM host is automatically re-added to the cluster after reboot

Đang mở
#13,693 6 bình luận 0 reaction 0 người được giao Được @wido nhận Xem trên GitHub
status:has-work-around status:needs-functional-definition
Ngôn ngữ chính
Java
Star
3.1k
Fork
1.4k
Merge trung bình
6 ngày 19 giờ
Pull request đã merge (30 ngày)
32

Mô tả

### problem

We removed a host from a CloudStack cluster containing multiple KVM hosts. Before deletion, the host was placed into maintenance mode, as required by CloudStack in order to remove it safely.

After the host had been deleted from CloudStack, the underlying physical server was rebooted because updates had been applied. The reboot itself was not expected to have any effect on CloudStack, since the host had already been removed from the management plane.

Unexpectedly, after the reboot, CloudStack rediscovered the machine and added it back to the same cluster as a new host. We also verified in the CloudStack database that the host entry had first been deleted and then recreated as a new record.

This behavior suggests that CloudStack is still able to rediscover a previously removed KVM host when the machine comes back online, even though it had already been deleted from CloudStack.

Expected behavior:

Once a host has been removed from CloudStack, rebooting the underlying physical server should not cause the host to be automatically rediscovered and re-added to the same cluster.

Actual behavior:

The deleted host was automatically added back to the cluster as a new host after the physical server reboot.

Environment:

CloudStack: 4.22.1.0

Hypervisor: KVM

Cluster: multiple hosts

Host state before deletion: maintenance mode

Host status after deletion: removed from CloudStack

Database observation: host entry was deleted and later recreated as a new entry

Additional details:

We did not manually re-add the host after deletion.

The host appears to have been rediscovered automatically by CloudStack after the reboot.

The issue occurred in a multi-host cluster environment.

### versions

CloudStack version: 4.22.1.0

OS and database versions:
We observed this behavior in two CloudStack installations:

Management Server OS: Ubuntu 24.04 LTS

Database: MySQL 8.x

KVM Host OS: AlmaLinux 9.8 and Ubuntu 24.04 LTS

### The steps to reproduce the bug

1. Migrate all VMs off the host.

2. Put the host into maintenance mode.

3. Remove the host from the cluster in CloudStack.

4. Reboot the physical server.

### What to do about it?

_No response_

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Hướng nghiên cứu

Bắt đầu với bốn bước tái hiện và kiểm tra PR đang mở #13719 để theo dõi quá trình điều tra hiện tại. Công việc được xem là hoàn tất khi một host bị xóa khỏi cluster không được tự động phát hiện lại hoặc tạo lại sau khi máy chủ vật lý của nó khởi động lại.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Đánh giá

Công nghệ
java
Lĩnh vực
cloud, infrastructure
Loại issue
Lỗi
Độ khó
4/5
Thời gian dự kiến
3-5 ngày
Mức độ hoạt động
Đình trệ
Độ rõ ràng
Khá rõ ràng
Mức phù hợp với người mới
25/100

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.