v11.2.1 Kraken

This is the first bugfix release for Kraken, and probably the last release ofthe Kraken series (Kraken will be declared “End Of Life” (EOL) when Luminousis declared stable). It contains a large number of bugfixes across all Cephcomponents.

We recommend that all v11.2.x users upgrade.

For more detailed information, see the complete changelog.

Notable Changes

  • In previous versions, if a client sent an op to the wrong OSD, the OSDwould reply with ENXIO. The rationale here is that the client or OSD isclearly buggy and we want to surface the error as clearly as possible.We now only send the ENXIO reply if the osd_enxio_on_misdirected_op optionis enabled (it’s off by default). This means that a VM using librbd thatpreviously would have gotten an EIO and gone read-only will now see ablocked/hung IO instead.

  • There was a bug introduced in Jewel (#19119) that broke the mapping behaviorwhen an “out” OSD that still existed in the CRUSH map was removed with ‘osd rm’.This could result in ‘misdirected op’ and other errors. The bug is now fixed,but the fix itself introduces the same risk because the behavior may vary betweenclients and OSDs. To avoid problems, please ensure that all OSDs are removedfrom the CRUSH map before deleting them. That is, be sure to do:

  1. ceph osd crush rm osd.123

before:

  1. ceph osd rm osd.123
  • This release greatly improves control and throttling of the snap trimmer. Itintroduces the “osd max trimming pgs” option (defaulting to 2), which limitshow many PGs on an OSD can be trimming snapshots at a time. And it restoresthe safe use of the “osd snap trim sleep” option, which defaults to 0 butotherwise adds the given number of seconds in delay between every dispatchof trim operations to the underlying system.

Other Notable Changes