canonical / canonical/microceph
Cannot get microceph to play nicely with xcp_ng
- Dominant language
- Go
- Stars
- 396
- Forks
- 74
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 7
Description
I have been trying all day to get microcloud running on three xcp_ng VM's with no success at all.
Everything seems to work, except microceph. Apparmour just hates /dev/xvd* disks.
2026-01-15T10:50:55.380411+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.378:239): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380469+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:240): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380505+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:241): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:242): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:243): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:244): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:245): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380507+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:246): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380515+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:247): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.380530+00:00 testmicro1 kernel: audit: type=1400 audit(1768474255.379:248): apparmor="DENIED" operation="open" class="file" profile="snap.microceph.osd" name="/dev/xvdb" pid=9960 comm="ceph-osd" requested_mask="wr" denied_mask="wr" fsuid=0 ouid=0
2026-01-15T10:50:55.381528+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.379+0000 7648062c6640 -1 bdev(0x61a0129eea80 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.382260+00:00 testmicro1 microceph.osd[9960]: message repeated 5 times: [ 2026-01-15T10:50:55.379+0000 7648062c6640 -1 bdev(0x61a0129eea80 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied]
2026-01-15T10:50:55.403456+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.402+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.408894+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.407+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.410131+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.408+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.410612+00:00 testmicro1 microceph.osd[9960]: 2026-01-15T10:50:55.409+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied
2026-01-15T10:50:55.410976+00:00 testmicro1 microceph.osd[9960]: message repeated 2 times: [ 2026-01-15T10:50:55.409+0000 7648062c6640 -1 bdev(0x61a0129eee00 /var/lib/ceph/osd/ceph-3/block) open open got: (13) Permission denied]
I have tried adding /dev/xvd[a-x] rwk to
/var/lib/snapd/apparmor/profiles/snap.microceph.daemon
under "access to individual partitions" and to "access to raw devices" with absolutely no joy at all (change the config and reboot to load the config).
On all three machines.
Can anyone shed any light on this or do I just give up on microcloud?
Thanks.
Peter.
Contributor guide
Assessment
This issue has not been assessed yet.