v1.11.0

Upgrade Guide

To upgrade from previous versions of Rook, see the Rook upgrade guide.

Breaking Changes

• The minimum version of K8s version supported is v1.21.
• The minimum version of the Ceph-CSI driver is v3.7.
• Removed support for MachineDisruptionBudgets, including settings removed from the CephCluster CR:
  • manageMachineDisruptionBudgets
  • machineDisruptionBudgetNamespace
• Versions of golang supported during development are v1.19 and v1.20.

Features

• Ceph-CSI v3.8 is now the version deployed by default with Rook. The driver has a number of important updates to add more storage features available to clients.
• Added setting requireMsgr2 on the CephCluster CR to allow clusters with a kernel of 5.11 or newer to fully communicate with msgr2 and disable the msgr1 port. This allows for more flexibility to enable msgr2 features such as encryption and compression on the wire.
• Change pspEnable default value to false in helm charts, and remove documentation for enabling PSP.
  If still using a version of K8s where PSPs are required, see the v1.10 documentation.
• Object store bucket notifications and topics are now marked as stable features.
• The Ceph exporter daemon is configured as the source of metrics based on performance counters from Ceph daemons. The exporter daemon
  provides more scalability of metrics collection to reduce load on the Ceph mgr.
• Read affinity for RBD volumes is now available, leveraging the krbd map options to allow serving reads from an OSD in proximity to the client, according to OSD locations defined in the CRUSH map and topology labels on nodes.
• Mirroring data across clusters with overlapping networks is now supported. Mon and OSD services will be configured with global IPs across multiple clusters with overlapping CIDRs. The clusters must be configured using an MCS API-compatible applications such as submariner globalnet. This feature is supported for Ceph version v17.2.6 or later.
• The Ceph Mgr standby now is managed with a readiness probe instead of a sidecar. Note that the standby mgr is expected to fail the readiness probe, while the active mgr passes the readiness probe.

v1.10.12

Improvements

Rook v1.10.12 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• osd: Handle device name change and device removal correctly (#11567, @satoru-takeuchi)
• object: Update object store user caps (#11716, @microyahoo)
• csi: Add missing node access to CephFS driver (#11697, @Madhu-1)
• object: Handle RGW metadata PG count reduction on 16.2.11 (#11673, @travisn)
• osd: Ensure rook version label is not set on OSD pod (#11674, @travisn)
• rbdmirror: set log rotation for rbd mirroring daemon to 28 rotations (#11594, @subhamkrai)

v1.10.11

Improvements

Rook v1.10.11 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• rgw: Handle insecure flag skip for object bucket notification in the tls config (#11630, @microyahoo)
• operator: Fix webhook logging during deletion (#11593, @subhamkrai)
• helm: Add labels and annotations to config overrides configmap (#11616, @travisn)
• ci: Change ceph version of osd on pvc canary test to avoid failures (#11646, @satoru-takeuchi)
• mds: Support the Shared filesystem with multus (#11611, @subhamkrai)
• docs: Add glossary page (#11525, @gauravsitlani)
• docs: Add export path example for NFS CSI (#11601, @BlaineEXE)
• file: Retry CephFS Status updates (#11453, @aruniiird)
• csi: add default version to images if it is missing (#11577, @Rakshith-R)
• external: Skip RGW validation for python version 2 (#11579, @parth-gr)
• mgr: Add patch verb to RBAC for completing ceph requests in orch module (#11538, @gaord)

v1.10.10

Improvements

Rook v1.10.10 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• core: Fix regression in v1.10.9 causing PVC mounts to fail in clusters with older kernels where encryption is not enabled (#11554, @Madhu-1)
• csi: Enable custom ceph.conf overrides for csi pods that was being ignored (#11556, @Madhu-1)
• docs: Correctly indent ceph cluster crd list items (#11546, @galexrt)
• docs: Remove obsolete health checker related option in object-external.yaml (#11543, @thotz)

v1.10.9

Improvements

Rook v1.10.9 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

This release is not recommended due to #11541, which is fixed in v1.10.10.

• webhook: Disable the admission controller by default and move its setting to the operator configmap (#11532, @subhamkrai)
• ceph: Set rbd_default_map_options for encryption (#11523, @Madhu-1)
• helm: Process the namespace in the storage classes to be the same as the release namespace (#11517, @jouve)
• csi: Update sidecar images to the latest release versions (#11510, @Madhu-1)
• helm: Use the Ceph image instead of the Rook image for the toolbox spec (#11127, @LoicGombeaud)
• external: Skip reporting telemetry if the cluster is external (#11493, @parth-gr)
• osd: Enable device expansion for OSDs in a host-based cluster (#11483, @cupnes)
• docs: Recommended memory limits for the osd prepare job when limits are required (#11512, @anthonyeleven)
• docs: Fix grafana dashboard links (#11506, @TimJones)

v1.10.8

Improvements

Rook v1.10.8 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• helm: Allow to specify allowed topologies for storage class (#11377, @steache)
• docs: Auto generate helm docs (#11346, @zalsader)
• ci: Build with Go 1.19 in the CI (#11427, @Rajpratik71)
• operator: Debug logging admission controller deletion (#11448, @subhamkrai)
• core: Allow ceph.conf to be updated if it already exists (#11399, @travisn)
• osd: Create OSDs without overriding with the /dev/mapper alias (#11301, @ausias-armesto)
• osd: Replace dot with dash in device set names since used as volume names (#11414, @travisn)
• core: Read mon secret from file instead of an env var in the mgr, osd prepare, and toolbox (#11434, @travisn)
• core: Remove unnecessary env vars from pod specs (#11331, @travisn)
• operator: Clean up webhook when disabled (#11432, @subhamkrai)
• docs: Import external K8s cluster on existing cluster (#11405, @parth-gr)
• csi: Add missing update RBAC for CephFS and NFS (#11468, @Madhu-1)
• ci: upgrade minikube action to latest version (#11439, @subhamkrai)
• osd: Allow mpath_member FSType for mpath disks (#11413, @travisn)
• osd: Remove stale dm device during osd-prepare-job (#11387, @Rakshith-R)

v1.10.7

Improvements

Rook v1.10.7 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• rgw: Set the number of RGW metadata pool PGs to 8 even for Ceph v17.2.2 or newer (#11024, @thotz)
• core: Set env var for ceph msgr to always use random nonce for OSD reliability after restart (#11373, @travisn)
• osd: Re-open encrypted disk during osd-prepare-job if closed (#11338, @Rakshith-R)
• osd: Improve log on specifying lv and loop device as osd (#11361, @satoru-takeuchi)
• core: Parse peer pool output with --out-file flag in case debug logging is enabled (#11337, @sp98)
• csi: Add a parameter maxUnavailable to the RBD daemonset. (#11334, @peng225)
• object: Update to latest OBC controller to fix the OB status (#11342, @BlaineEXE)

v1.10.6

Improvements

Rook v1.10.6 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• crash: Crash collectors in wrong namespaces were deleted (#11322, @haslersn)
• helm: Allow setting DISCOVER_DAEMON_UDEV_BLACKLIST (#11303, @JensErat)
• docs: Add additional RBD image features to docs and YAML files (#10652, @anthonyeleven)
• core: Include userID/userKey to secret generated from CephClient (#11280, @avanthakkar)
• mon: Remove out of quorum mons from ceph.conf for improved connectivity during failover or partial quorum (#10887, @travisn)
• object: Mark endpoint as a optional field (#11300, @iamniting)
• osd: Support loop devices for test clusters (#11268, @peng225)
• core: Allow setting resources on the discovery daemon (#11278, @parth-gr)
• object: Do not create service for external object stores (#11202, @BlaineEXE)
• mon: Apply mon store settings more efficiently with the assimilate conf (#11241, @travisn)
• docs: Clarify in docs and readme that Rook focuses on Ceph (#11290, @travisn)
• docs: Set CRD page titles to the CRD name (#11289, @travisn)
• docs: Clarification for NixOS deployment properties (#11269, @yajo)

v1.10.5

Improvements

Rook v1.10.5 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• security: Run the crash collector as ceph user (#11219, @travisn)
• security: Update s5cmd to v2.0.0 (#11223, @Rajpratik71)
• core: Validate object store CR name length in admission controller (#11233, @parth-gr)
• osd: Add deviceClass label to an OSD (#11159, @parth-gr)
• docs: Update disaster recovery guide to disable the webhook (#11256, @subhamkrai)
• docs: Added steps to collect coredump and perf troubleshooting info (#11213, @gauravsitlani)
• pool: Add timeout to rbd init cmd (#10721, @zhucan)
• mon: The mon daemons maintain host network settings to allow change in config (#11211, @travisn)
• core: Retry when removing finalizers from cluster resources during cluster deletion (#11179, @travisn)
• core: Upgrade ceph to latest release v17.2.5 (#11198, @subhamkrai)
• docs: Improve troubleshooting docs on restoring CRDs after deletion (#11154, @alexander-bauer)

v1.9.13

Improvements

Rook v1.9.13 is a patch release limited in scope and focusing on feature additions and bug fixes to the Ceph operator.

• security: Run the crash collector as ceph user (#11219, @travisn)
• security: Update s5cmd to v2.0.0 (#11223, @Rajpratik71)
• ci: Update mon_data_avail_warn to a valid percentage for test clusters (#11131, @parth-gr)