canonical / canonical/microceph

unable to add more osds

Open
#366 2 comments 0 reactions 1 assignee Claimed by @UtkarshBhatthere View on GitHub
Needs Investigation
Dominant language
Go
Stars
396
Forks
74
Avg merge
2d 20h
Merged PRs (30d)
7

Description

# Issue report

## What version of MicroCeph are you using ?
microceph 18.2.0+snap556b907075 1026 reef/edge canonical✓ held
running under sunbeam cluster (openstack 2024.1/edge rev.531

This information can be fetched from the `installed:` section of `sudo snap info microceph` output.
name: microceph
summary: Simple clustered Ceph deployment
publisher: Canonical✓
store-url: https://snapcraft.io/microceph
contact: https://matrix.to/#/#ubuntu-ceph:matrix.org
license: AGPL-3.0
description: |
MicroCeph is the easiest way to get up and running with Ceph. It is focused on providing a modern
deployment and management experience to Ceph administrators and storage software developers.

The below commands will set you up with a testing environment on a single machine using
file-backed OSDs - you'll need about 15 GiB of available space on your root drive:

sudo snap install microceph
sudo snap refresh --hold microceph
sudo microceph cluster bootstrap
sudo microceph disk add loop,4G,3
sudo ceph status

You're done!

You can remove everything cleanly with:

sudo snap remove microceph

To learn more about MicroCeph see the documentation:

https://canonical-microceph.readthedocs-hosted.com
commands:
- microceph.ceph
- microceph
- microceph.rados
- microceph.radosgw-admin
- microceph.rbd
services:
microceph.daemon: simple, enabled, active
microceph.mds: simple, enabled, active
microceph.mgr: simple, enabled, active
microceph.mon: simple, enabled, active
microceph.osd: simple, enabled, active
microceph.rgw: simple, disabled, inactive
snap-id: ct1DgtIGBaljdOwomQGMLr8EJcL5pOP1
tracking: reef/edge
refresh-date: today at 13:27 CEST
hold: forever
channels:
reef/stable: 18.2.0+snap71f71782c5 2024-05-28 (981) 87MB -
reef/candidate: 18.2.0+snapcba31e8c75 2024-06-05 (999) 87MB -
reef/beta: 18.2.0+snap38155f2c4e 2024-06-07 (1015) 87MB -
reef/edge: 18.2.0+snap556b907075 2024-06-12 (1026) 86MB -
latest/stable: 18.2.0+snap71f71782c5 2024-05-28 (981) 87MB -
latest/candidate: 18.2.0+snapcba31e8c75 2024-06-05 (999) 87MB -
latest/beta: ↑
latest/edge: 18.2.0+snap556b907075 2024-06-12 (1026) 86MB -
squid/stable: –
squid/candidate: –
squid/beta: –
squid/edge: 19.2.0~git+snap44f97f5158 2024-06-06 (1011) 89MB -
quincy/stable: 0+git.4a608fc 2024-01-10 (793) 96MB -
quincy/candidate: 0+git.4a608fc 2023-11-30 (793) 96MB -
quincy/beta: ↑
quincy/edge: 0+git.287ee68 2023-12-05 (807) 96MB -
installed: 18.2.0+snap556b907075 (1026) 86MB held

## What are the steps to reproduce this issue ?
Unable to add some osds from this node

sudo microceph.ceph osd ls
show 44 osd ids

sudo microceph disk list
show 58 osd ids

sudo microceph.ceph status | grep since
osd: 44 osds: 44 up (since 3h), 44 in (since 3h)

## What happens (observed behaviour) ?

by using these comand
sudo microceph disk remove 84 (and all other not showed as output of ceph osd ls)

and readding
sudo microceph -d disk add /dev/disk/by-id/wwn-0x... --wipe

the command output
+----------------------------------------+---------+
| PATH | STATUS |
+----------------------------------------+---------+
| /dev/disk/by-id/wwn-0x... | Success |
+----------------------------------------+---------+

but still not visible in sudo microceph.ceph osd ls

## What were you expecting to happen ?

sudo microceph.ceph osd ls showing the id of the last readded osds

## Relevant logs, error output, etc.

node-03:/var/snap/microceph/common/logs$ sudo systemctl status snap.microceph.osd.service
● snap.microceph.osd.service - Service for snap application microceph.osd
Loaded: loaded (/etc/systemd/system/snap.microceph.osd.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2024-06-13 16:56:54 CEST; 1s ago
Main PID: 1760306 (osd.start)
Tasks: 10 (limit: 618608)
Memory: 9.8M
CPU: 121ms
CGroup: /system.slice/snap.microceph.osd.service
├─1760306 /bin/sh /snap/microceph/1026/commands/osd.start
└─1760344 ceph-osd --cluster ceph --id 16
NO OTTHER ID PRESENT (and also Id are wrong) id 16 of sudo microceph disk list is a node 01 osds....

## Additional comments.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.