Messaging

General Settings

ms tcp nodelay

Description

Disables nagle’s algorithm on messenger tcp sessions.

Type

Boolean

Required

No

Default

true

ms initial backoff

Description

The initial time to wait before reconnecting on a fault.

Type

Double

Required

No

Default

.2

ms max backoff

Description

The maximum time to wait before reconnecting on a fault.

Type

Double

Required

No

Default

15.0

ms nocrc

Description

Disables crc on network messages. May increase performance if cpu limited.

Type

Boolean

Required

No

Default

false

ms die on bad msg

Description

Debug option; do not configure.

Type

Boolean

Required

No

Default

false

ms dispatch throttle bytes

Description

Throttles total size of messages waiting to be dispatched.

Type

64-bit Unsigned Integer

Required

No

Default

100 << 20

ms bind ipv6

Description

Enable if you want your daemons to bind to IPv6 address instead of IPv4 ones. (Not required if you specify a daemon or cluster IP.)

Type

Boolean

Required

No

Default

false

ms rwthread stack bytes

Description

Debug option for stack size; do not configure.

Type

64-bit Unsigned Integer

Required

No

Default

1024 << 10

ms tcp read timeout

Description

Controls how long (in seconds) the messenger will wait before closing an idle connection.

Type

64-bit Unsigned Integer

Required

No

Default

900

ms inject socket failures

Description

Debug option; do not configure.

Type

64-bit Unsigned Integer

Required

No

Default

0

Async messenger options

ms async transport type

Description

Transport type used by Async Messenger. Can be posix, dpdk or rdma. Posix uses standard TCP/IP networking and is default. Other transports may be experimental and support may be limited.

Type

String

Required

No

Default

posix

ms async op threads

Description

Initial number of worker threads used by each Async Messenger instance. Should be at least equal to highest number of replicas, but you can decrease it if you are low on CPU core count and/or you host a lot of OSDs on single server.

Type

64-bit Unsigned Integer

Required

No

Default

3

ms async max op threads

Description

Maximum number of worker threads used by each Async Messenger instance. Set to lower values when your machine has limited CPU count, and increase when your CPUs are underutilized (i. e. one or more of CPUs are constantly on 100% load during I/O operations).

Type

64-bit Unsigned Integer

Required

No

Default

5

ms async send inline

Description

Send messages directly from the thread that generated them instead of queuing and sending from Async Messenger thread. This option is known to decrease performance on systems with a lot of CPU cores, so it’s disabled by default.

Type

Boolean

Required

No

Default

false