Messaging

General Settings

ms tcp nodelay

  • Description

  • Disables nagle’s algorithm on messenger tcp sessions.

  • Type

  • Boolean

  • Required

  • No

  • Default

  • true

ms initial backoff

  • Description

  • The initial time to wait before reconnecting on a fault.

  • Type

  • Double

  • Required

  • No

  • Default

  • .2

ms max backoff

  • Description

  • The maximum time to wait before reconnecting on a fault.

  • Type

  • Double

  • Required

  • No

  • Default

  • 15.0

ms nocrc

  • Description

  • Disables crc on network messages. May increase performance if cpu limited.

  • Type

  • Boolean

  • Required

  • No

  • Default

  • false

ms die on bad msg

  • Description

  • Debug option; do not configure.

  • Type

  • Boolean

  • Required

  • No

  • Default

  • false

ms dispatch throttle bytes

  • Description

  • Throttles total size of messages waiting to be dispatched.

  • Type

  • 64-bit Unsigned Integer

  • Required

  • No

  • Default

  • 100 << 20

ms bind ipv6

  • Description

  • Enable if you want your daemons to bind to IPv6 address instead of IPv4 ones. (Not required if you specify a daemon or cluster IP.)

  • Type

  • Boolean

  • Required

  • No

  • Default

  • false

ms rwthread stack bytes

  • Description

  • Debug option for stack size; do not configure.

  • Type

  • 64-bit Unsigned Integer

  • Required

  • No

  • Default

  • 1024 << 10

ms tcp read timeout

  • Description

  • Controls how long (in seconds) the messenger will wait before closing an idle connection.

  • Type

  • 64-bit Unsigned Integer

  • Required

  • No

  • Default

  • 900

ms inject socket failures

  • Description

  • Debug option; do not configure.

  • Type

  • 64-bit Unsigned Integer

  • Required

  • No

  • Default

  • 0

Async messenger options

ms async transport type

  • Description

  • Transport type used by Async Messenger. Can be posix, dpdkor rdma. Posix uses standard TCP/IP networking and is default.Other transports may be experimental and support may be limited.

  • Type

  • String

  • Required

  • No

  • Default

  • posix

ms async op threads

  • Description

  • Initial number of worker threads used by each Async Messenger instance.Should be at least equal to highest number of replicas, but you candecrease it if you are low on CPU core count and/or you host a lot ofOSDs on single server.

  • Type

  • 64-bit Unsigned Integer

  • Required

  • No

  • Default

  • 3

ms async max op threads

  • Description

  • Maximum number of worker threads used by each Async Messenger instance.Set to lower values when your machine has limited CPU count, and increasewhen your CPUs are underutilized (i. e. one or more of CPUs areconstantly on 100% load during I/O operations).

  • Type

  • 64-bit Unsigned Integer

  • Required

  • No

  • Default

  • 5

ms async send inline

  • Description

  • Send messages directly from the thread that generated them instead ofqueuing and sending from Async Messenger thread. This option is knownto decrease performance on systems with a lot of CPU cores, so it’sdisabled by default.

  • Type

  • Boolean

  • Required

  • No

  • Default

  • false