How to use gfs2/dlm directly

-------------------------------------------------------------------------------

1. create /etc/corosync/corosync.conf and copy to all nodes

In this sample, replace cluster_name and IP addresses; add nodes as needed.

totem { 
        version: 2
        secauth: off
        cluster_name: abc
}

nodelist {
        node {  
                ring0_addr: 10.10.10.1
                nodeid: 1
        }
        node {  
                ring0_addr: 10.10.10.2
                nodeid: 2
        }
        node {  
                ring0_addr: 10.10.10.3
                nodeid: 3
        }
}

quorum {
        provider: corosync_votequorum
}

logging {
        to_syslog: yes
}

-------------------------------------------------------------------------------

2. start corosync on all nodes

Use corosync init script, or manually run:

# corosync

Run corosync-quorumtool to verify that all nodes are listed.

-------------------------------------------------------------------------------

3. create /etc/dlm/dlm.conf and copy to all nodes

* To use no fencing, use this line:

enable_fencing=0

* To use no fencing, but exercise fencing functions, use this line:

fence_all /bin/true

* To use manual fencing, use this line:

fence_all /bin/false

(When a node fails, manually run: dlm_tool fence_ack <nodeid>)

* To use stonith/pacemaker for fencing, use this line:

fence_all /usr/sbin/dlm_stonith

(This is the default fence_all setting, so setting this explicitly is not
required; in this case, dlm.conf may be empty.  This setting can be used
without stonith/pacemaker, in which case it becomes equivalent to the
/bin/false setting above, and can be overriden with dlm_tool fence_ack.)

* To use an APC power switch, use these lines:

device  apc /usr/sbin/fence_apc ipaddr=1.1.1.1 login=admin password=pw
connect apc node=1 port=1
connect apc node=2 port=2
connect apc node=3 port=3

* For other fencing configurations see dlm.conf(5) man page.

-------------------------------------------------------------------------------

4. start dlm_controld on all nodes

Use dlm init script, or manually run:

# modprobe gfs2 (also loads dlm and configfs modules)
# mount -t configfs none /sys/kernel/config
# dlm_controld

Run "dlm_tool status" to verify that all nodes are listed.

-------------------------------------------------------------------------------

5. if using clvm, start clvmd from init script or manually
6. make/mount gfs2 file systems
7. shut down: use init scripts, or manually run:
   unmount, killall clvmd, killall dlm_controld, killall corosync

-------------------------------------------------------------------------------