apache / apache/cloudstack

GET certain paths like systemVM and networkofferings are very very slow

未关闭
#12,740 6 条评论 0 个 reaction 已指派 1 人 已被 @shwstppr 认领 在 GitHub 查看
status:needs-reproducing
主要语言
Java
星标
3.1k
派生
1.4k
平均合并
6 天 19 小时
30 天内合并 PR
32

描述

### problem

**Background**
We have just recently deployed our first production Cloudstack environment.
At the moment we have 2 zones 1 pod 1 cluster, with 4 hosts each inside.
In total we have created 4 extra networkofferings over the default ones, 5 shared networks and 5 instances.
And we have 4 systemvm's.
So as you can understand its still a very small deployment still.

Our management server is a VM.
Running on a oVirt cluster.
VM is 4 cores and 8GB ram.
MariaDB and CS Mangement server are located on the same VM.

**Issue**
When we try to GET certain paths either if its using the webui or cloudmonkey script the load times are very long and our MariaDB goes to 100% for a while on one core.
Path where the issue is seen are:
GET systemVMs ~45 seconds
GET networkofferings ~50seconds

Image

Doing following select queries towards the MariaDB the response back is instant and no load seen on the DB.
```
select * from network_offerings;
select * from console_proxy;
select * from vm_instance;
select * from secondary_storage_vm;
```

**More Background**
During the setup we accidently imported each ldap user entry as a domain resulted in ~52k now inactive domains. I believe that we started seeing this issue after that was done. We have deleted each domain but they still show up when doing a select * from domain but as inactive.
I also remember that we had alot of systemvm entries during the first cluster because cloudstack had some network issue and it created alot of systemvm entries. But they have also been deleted.

I have enabled expunged.resources.purge.enabled
And i have cleaned up our event and alert tables.

### versions

ACS 4.22

### The steps to reproduce the bug

Not been able to reproduce the issue.

### What to do about it?

_No response_

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。