Configuring OCFS2 Clustered File System on Debian Based Linux including Ubuntu and Kubuntu

There's a lot of information and guides on OCFS2 for RHEL and Centos Linux but the package setup and configuration is slightly different and this has thrown some people off.

Installing OC2FS

You should install the following packages to get started:

apt-get install ocfs2-tools ocfs2console

Configure OC2FS

In RHEL/Centos the main configuration file is located in /etc/sysconfig/o2cb

However in Debian based Linux it is located in: /etc/default/o2cb (I don't think either make sense, why not just have a dir inside /etc/ called ocfs2 ?)

Open the file: /etc/default/o2cb and change the following line:

O2CB_ENABLED=false

to O2CB_ENABLED=true

This enables OCFS2 to startup at boot time (which you obviously should want if you are using such a filesystem).

Setup OC2FS cluster.conf

You'll need to manually create this path:

mkdir /etc/ocfs2

now touch /etc/ocfs2/cluster.conf

Here is the cluster.conf I created (you can have less/more nodes if you like):

node:
        ip_port = 7777
        ip_address = 192.168.1.115
        number = 1
        name = one
        cluster = ocfs2
node:
        ip_port = 7777
        ip_address = 192.168.1.116
        number = 2
        name = two
        cluster = ocfs2
cluster:
        node_count = 2
        name = ocfs2

The hostname must be correct for the node, meaning it has to be the actual hostname.

Under "cluster" that is the name you will be calling your cluster. Make sure that in /etc/default/o2cb the parameter matches (by default it is set to ocfs2 but it can be changed if you like).

Also make sure under each node that the cluster value is correct.  cluster is the name of the OCFS2 filesystem/cluster you want those nodes to belong to.

Move cluster.conf to each node (remember that each node must have the exact same cluster.conf)

Start the o2cb service: /etc/init.d/o2cb start

Loading module "configfs": OK
Mounting configfs filesystem at /sys/kernel/config: OK
Loading module "ocfs2_nodemanager": OK
Loading module "ocfs2_dlm": OK
Loading module "ocfs2_dlmfs": OK
Mounting ocfs2_dlmfs filesystem at /dlm: OK
Starting O2CB cluster ocfs2: OK

 Checking the status of o2cb should show something like this (if everything is correct):

/etc/init.d/o2cb status
Module "configfs": Loaded
Filesystem "configfs": Mounted
Module "ocfs2_nodemanager": Loaded
Module "ocfs2_dlm": Loaded
Module "ocfs2_dlmfs": Loaded
Filesystem "ocfs2_dlmfs": Mounted
Checking O2CB cluster ocfs2: Online
Heartbeat dead threshold = 7
  Network idle timeout: 10000
  Network keepalive delay: 5000
  Network reconnect delay: 2000
Checking O2CB heartbeat: Active

Format your OCFS2 partition:

mkfs.ocfs2 -b 4k -C 32K -L "MyOCFS2Cluster" -N 4 /dev/sda2

Make sure you replace "/dev/sda2" with the partition you want.  Don't make a mistake here because you'll lose all data on whatever partition you specify.

The "-N 4" stands for slots for up to 4 nodes, note that this can be increased but can't be decreased.  You shouldn't have a number higher than you need (or at least not much).  The Oracle documentation says you can always add more node slots though.

Mount your OCFS2 partition

mount /dev/sda2 /mnt/sda2

Debian/Kubuntu Error when mounting

On Kubuntu 8.04 I got this error, I'm not sure if the Debian package itself has this problem but here it goes:

mount.ocfs2: Node manager kernel module is not loaded probably because o2cb service not started

Everything is fine configuration file wise, but there is a bug in the init script provided by the Kubuntu Package.

You can fix it by: adding "load_module ocfs2_stackglue" to the LOAD_ACTIONS in /etc/init.d/o2cb

Or you can just manually modprobe ocfs2_stackglue

This is supposed to be fix in the latest package, but as of the time of this writing (April 7th, 2009) the latest package is the one I have.  I guess the udpated version hasn't been distributed yet.


Tags:

configuring, ocfs, clustered, debian, linux, ubuntu, kubuntuthere, guides, rhel, centos, configuration, installing, oc, fs, install, packages, apt, console, configure, located, etc, sysconfig, cb, default, dir, cb_enabled, enables, startup, filesystem, cluster, conf, ll, manually, mkdir, nodes, node, ip_port, ip_address, node_count, hostname, quot, parameter, init, loading, module, configfs, ok, mounting, sys, kernel, config, _nodemanager, _dlm, _dlmfs, dlm, mounted, online, heartbeat, threshold, idle, timeout, keepalive, reconnect, active, format, partition, mkfs, myocfs, dev, sda, specify, slots, increased, decreased, shouldn, oracle, documentation, mount, mnt, kubuntu, provided, adding, load_module, _stackglue, load_actions, modprobe, april, udpated, hasn, distributed,

Latest Articles

  • How to allow SSH root user access in Linux/Debian/Mint/RHEL/Ubuntu/CentOS
  • Ansible Tutorial - Playbook How To Install From Scratch and Deploy LAMP + Wordpress on Remote Server
  • Ceph Install Errors on Proxmox / How To Fix Solution
  • Proxmox Update Error https://enterprise.proxmox.com/debian/pve bullseye InRelease 401 Unauthorized [IP: 144.217.225.162 443]
  • QEMU/KVM How to Hot-add A Virtual Disk .raw/.qcow2 via QEMU Monitor Commands
  • Proxmox How To Enable Ceph Distributed Storage Cluster with OSD and Pools
  • pulseaudio issue on QEMU/KVM guest VM when microphone is replugged/unplugged pulseaudio: pa_threaded_mainloop_lock failed pulseaudio: Reason: Invalid argument
  • Ubuntu Linux Mint - Volume Control Stopped Working
  • Proxmox Services Won't Start Failed to start The Proxmox VE cluster filesystem. Proxmox VE firewall. PVE Status Daemon. Proxmox VE scheduler. PVE Cluster HA Resource Manager Daemon. PVE Local HA Resource Manager Daemon.
  • Proxmox Guide FAQ / Errors / Howto
  • Virtualbox Vbox Issue Cannot Enable Nested Virtualization Button is Grayed/Greyed Out and Unclickable HowTo Solution
  • Virtualbox VBOX Howto Port Forward To Guests
  • Linux Ubuntu Debian Centos Mint - How To Check if Intel VT-x or AMD-V Hardware Virtualization is Enabled?
  • Linux Howto Zip Multiple Files and Directories
  • Windows Cannot Format USB drive Device Media is Write Protected Error Solution
  • Linux Mint 20 cannot install snapd missing solution
  • Virtualbox VBOX How To Install Guest-Utils/GuestUtils so drag and drop and clipboard works Ubuntu Mint Debian Linux
  • How to install Kubernetes with microk8s and deploy apps on Debian/Mint/Ubuntu Linux
  • vi how to delete everything to the end of the line or the rest of the line from the cursor
  • Cisco Howto Configure Console Port/Terminal/Comm Server with Async Cable Setup