canonical / canonical/microceph

Cannot get microceph to play nicely with xcp_ng

Open
#666 2 comments 0 reactions 0 assignees View on GitHub
APPARMOR Denials enhancement
Dominant language
Go
Stars
396
Forks
74
Avg merge
2d 20h
Merged PRs (30d)
7

Description

I have been trying all day to get microcloud running on three xcp_ng VM's with no success at all.

Everything seems to work, except microceph. Apparmour just hates /dev/xvd* disks.

2026-01-15T10:50:55.380411+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.378:239): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380469+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:240): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380505+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:241): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:242): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:243): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:244): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:245): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:246): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380515+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:247): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380530+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:248): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.381528+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.379+0000 7648062c6640 -1 bdev(0x61a0129eea80 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.382260+00:00 testmicro1 microceph.osd[9960]: message repeated 5 times: [ 2026-01-15T10:50:55.379+0000 7648062c6640 -1 bdev(0x61a0129eea80 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied]
2026-01-15T10:50:55.403456+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.402+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.408894+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.407+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.410131+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.408+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.410612+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.409+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.410976+00:00 testmicro1 microceph.osd[9960]: message repeated 2 times: [ 2026-01-15T10:50:55.409+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied]

I have tried adding /dev/xvd[a-x] rwk to
/var/lib/snapd/apparmor/profiles/snap.microceph.daemon

under "access to individual partitions" and to "access to raw devices" with absolutely no joy at all (change the config and reboot to load the config).

On all three machines.

Can anyone shed any light on this or do I just give up on microcloud?

Thanks.
Peter.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.