Kubernetes Cluster Requirements
A Kubernetes (from v1.17 to v1.21) cluster with at least 3 worker nodes.
- All-flash mode: no configuration is required.
- Hybrid-flash mode: there should be at least one available SSD on each worker node, and the SSD capacity should be larger than 60 GB.
- All-flash mode: there should be at least one available SSD on each worker node, and the SSD capacity should be larger than 60 GB.
- Hybrid-flash mode: there should be at least one available HDD on each worker node, and the HDD capacity should be larger than 60 GB.
Network cards of 10GbE or above are required for the IOMesh storage network.
Reserved System Space
At least 100GB of disk space is required in the /opt directory on each worker node for storing the IOMesh cluster metadata.
Worker Node Setup
Follow the steps below to set up each Kubernetes worker node that runs IOMesh.
Set Up Open-iSCSI
sudo yum install iscsi-initiator-utils -y
sudo apt-get install open-iscsi -y
sudo sed -i 's/^node.startup = automatic$/node.startup = manual/' /etc/iscsi/iscsid.conf
NOTE: The default value of the MaxRecvDataSegmentLength in /etc/iscsi/iscsi.conf is set at 32,768, and the maximum number of PVs is limited to 80,000 in IOMesh. To create PVs more than 80,000 in IOMesh, it is recommended to set the value of MaxRecvDataSegmentLength to 163,840 or above.
sudo setenforce 0 sudo sed -i 's/^SELINUX=enforcing$/SELINUX=permissive/' /etc/selinux/config
iscsi_tcpkernel module is loaded.
sudo modprobe iscsi_tcp sudo bash -c 'echo iscsi_tcp > /etc/modprobe.d/iscsi-tcp.conf'
sudo systemctl enable --now iscsid
Set Up Local Metadata Store
IOMesh stores metadata in the local path
/opt/iomesh. Ensure that there is at least 100Gb of available space at
Set Up Data Network
To avoid contention on network bandwidth, set up a separate network for the IOMesh Cluster. The
dataCIDR defines IP block for the IOMesh data network. Every node running IOMesh should have an interface with an IP address belonging to