ceph-nvmeof VS Rbd share over 200Gbit/s Network - Ope Debate

HI All,

This is an open debate for all the scientist and experts with storage solutions:

Hardware: 4 Node 48 CPU +256GB Memory + 200GB FIber Connectivity. Each Node has 6 NVME 900GB Drives.

Ceph Reef Version Installed on them with Vlan Network for internal connectivity.

1. PG size 1024 for pool
2. rbd to rbd share Read Iops for 4K is arond 750K/S
3. NvmeofGw rbd share over fiber is hardly 100K/s

any advise of configuration we can change to get max performance here. Any advise is much appreciated.

No source file, test, or entry point is named. Start by reviewing the Ceph Reef, RBD, NVMe-oF gateway, VLAN, PG-size, and hardware configuration, then reproduce the reported 4K read results on both paths. Done means identifying and validating a configuration change that explains and improves the performance gap.

Written by the indexing model from the issue text.