Notice

This document is for a development version of Ceph.

Warning

This document is for an unsupported version of Ceph.

Edit on GitHub | Report a Documentation Bug

Ceph Storage Cluster

The Ceph Storage Cluster is the foundation for all Ceph deployments. Based upon RADOS, Ceph Storage Clusters consist of two types of daemons: a Ceph OSD Daemon (OSD) stores data as objects on a storage node; and a Ceph Monitor (MON) maintains a master copy of the cluster map. A Ceph Storage Cluster may contain thousands of storage nodes. A minimal system will have at least one Ceph Monitor and two Ceph OSD Daemons for data replication.

The Ceph File System, Ceph Object Storage and Ceph Block Devices read data from and write data to the Ceph Storage Cluster.

Config and Deploy Ceph Storage Clusters have a few required settings, but most configuration settings have default values. A typical deployment uses a deployment tool to define a cluster and bootstrap a monitor. See Deployment for details on ceph-deploy. Configuration Storage devices Configuring Ceph Common Settings Networks Monitors Authentication OSDs Heartbeats Logs / Debugging Example ceph.conf Running Multiple Clusters Network Settings Messenger v2 protocol Auth Settings Monitor Settings Looking up Monitors through DNS Heartbeat Settings OSD Settings BlueStore Settings FileStore Settings Journal Settings Pool, PG & CRUSH Settings Messaging Settings General Settings Deployment Preflight Checklist Install Ceph Create a Cluster Add/Remove Monitor(s) Key Management Add/Remove OSD(s) Add/Remove MDS(s) Purge Hosts Admin Tasks

Operations Once you have a deployed a Ceph Storage Cluster, you may begin operating your cluster. Operations Operating a Cluster Health checks Monitoring a Cluster Monitoring OSDs and PGs User Management Repairing PG inconsistencies Data Placement Overview Pools Erasure code Cache Tiering Placement Groups Balancer Using the pg-upmap CRUSH Maps Manually editing a CRUSH Map Adding/Removing OSDs Adding/Removing Monitors Device Management BlueStore Migration Command Reference The Ceph Community Troubleshooting Monitors Troubleshooting OSDs Troubleshooting PGs Logging and Debugging CPU Profiling Memory Profiling Man Pages

APIs Most Ceph deployments use Ceph Block Devices, Ceph Object Storage and/or the Ceph File System. You may also develop applications that talk directly to the Ceph Storage Cluster. APIs Introduction to librados librados (C) librados (C++) librados (Python) object class