canonical / canonical/microceph
unable to add more osds
- Dominant language
- Go
- Stars
- 396
- Forks
- 74
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 7
Description
# Issue report
## What version of MicroCeph are you using ?
microceph 18.2.0+snap556b907075 1026 reef/edge canonical✓ held
running under sunbeam cluster (openstack 2024.1/edge rev.531
This information can be fetched from the `installed:` section of `sudo snap info microceph` output.
name: microceph
summary: Simple clustered Ceph deployment
publisher: Canonical✓
store-url: https://snapcraft.io/microceph
contact: https://matrix.to/#/#ubuntu-ceph:matrix.org
license: AGPL-3.0
description: |
MicroCeph is the easiest way to get up and running with Ceph. It is focused on providing a modern
deployment and management experience to Ceph administrators and storage software developers.
The below commands will set you up with a testing environment on a single machine using
file-backed OSDs - you'll need about 15 GiB of available space on your root drive:
sudo snap install microceph
sudo snap refresh --hold microceph
sudo microceph cluster bootstrap
sudo microceph disk add loop,4G,3
sudo ceph status
You're done!
You can remove everything cleanly with:
sudo snap remove microceph
To learn more about MicroCeph see the documentation:
https://canonical-microceph.readthedocs-hosted.com
commands:
- microceph.ceph
- microceph
- microceph.rados
- microceph.radosgw-admin
- microceph.rbd
services:
microceph.daemon: simple, enabled, active
microceph.mds: simple, enabled, active
microceph.mgr: simple, enabled, active
microceph.mon: simple, enabled, active
microceph.osd: simple, enabled, active
microceph.rgw: simple, disabled, inactive
snap-id: ct1DgtIGBaljdOwomQGMLr8EJcL5pOP1
tracking: reef/edge
refresh-date: today at 13:27 CEST
hold: forever
channels:
reef/stable: 18.2.0+snap71f71782c5 2024-05-28 (981) 87MB -
reef/candidate: 18.2.0+snapcba31e8c75 2024-06-05 (999) 87MB -
reef/beta: 18.2.0+snap38155f2c4e 2024-06-07 (1015) 87MB -
reef/edge: 18.2.0+snap556b907075 2024-06-12 (1026) 86MB -
latest/stable: 18.2.0+snap71f71782c5 2024-05-28 (981) 87MB -
latest/candidate: 18.2.0+snapcba31e8c75 2024-06-05 (999) 87MB -
latest/beta: ↑
latest/edge: 18.2.0+snap556b907075 2024-06-12 (1026) 86MB -
squid/stable: –
squid/candidate: –
squid/beta: –
squid/edge: 19.2.0~git+snap44f97f5158 2024-06-06 (1011) 89MB -
quincy/stable: 0+git.4a608fc 2024-01-10 (793) 96MB -
quincy/candidate: 0+git.4a608fc 2023-11-30 (793) 96MB -
quincy/beta: ↑
quincy/edge: 0+git.287ee68 2023-12-05 (807) 96MB -
installed: 18.2.0+snap556b907075 (1026) 86MB held
## What are the steps to reproduce this issue ?
Unable to add some osds from this node
sudo microceph.ceph osd ls
show 44 osd ids
sudo microceph disk list
show 58 osd ids
sudo microceph.ceph status | grep since
osd: 44 osds: 44 up (since 3h), 44 in (since 3h)
## What happens (observed behaviour) ?
by using these comand
sudo microceph disk remove 84 (and all other not showed as output of ceph osd ls)
and readding
sudo microceph -d disk add /dev/disk/by-id/wwn-0x... --wipe
the command output
+----------------------------------------+---------+
| PATH | STATUS |
+----------------------------------------+---------+
| /dev/disk/by-id/wwn-0x... | Success |
+----------------------------------------+---------+
but still not visible in sudo microceph.ceph osd ls
## What were you expecting to happen ?
sudo microceph.ceph osd ls showing the id of the last readded osds
## Relevant logs, error output, etc.
node-03:/var/snap/microceph/common/logs$ sudo systemctl status snap.microceph.osd.service
● snap.microceph.osd.service - Service for snap application microceph.osd
Loaded: loaded (/etc/systemd/system/snap.microceph.osd.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2024-06-13 16:56:54 CEST; 1s ago
Main PID: 1760306 (osd.start)
Tasks: 10 (limit: 618608)
Memory: 9.8M
CPU: 121ms
CGroup: /system.slice/snap.microceph.osd.service
├─1760306 /bin/sh /snap/microceph/1026/commands/osd.start
└─1760344 ceph-osd --cluster ceph --id 16
NO OTTHER ID PRESENT (and also Id are wrong) id 16 of sudo microceph disk list is a node 01 osds....
## Additional comments.
…
Contributor guide
Assessment
This issue has not been assessed yet.