Monitor IOMesh
After importing Grafana, you will see the dashboard shown below. Refer to Grafana Docs for more configurations and adjustments.
IOMesh provide 5 rows of contents for monitoring IOMesh storage:
- Overview
- Node
- Details of Node
- Physical Disk
- Persistent Volume
Overview
Shows IOMesh cluster information and resource usage.
| Panel | Description |
|---|---|
| Alert | Shows all alarms detected in the IOMesh cluster, by default presenting essential details such as alarm names, trigger status, and duration. You can further investigate into the severity, reasons, impacts, and recommended solutions for each alarm, and set the threshold for alert rules on your own on the Alert page. Due to a Grafana defect, the values of all alarm items are presented in scientific notation. |
| Cluster Info | Shows the basic information of the IOMesh cluster, including IOMesh version, IOMesh block storage version, CPU architecture, license type, license edition, maximum number of nodes, and license expiration date. |
| Node | Shows the total number of nodes in the IOMesh cluster and how many of them are in the unhealthy state. |
| Physical Disk | Shows the number of total SSDs, total HDDs, unhealthy SSDs and HDDs, respectively. |
| Persistent Volume | Shows the total number of all persistent volumes in the IOMesh cluster. |
| PV Status | Shows the number of persistent volumes in different states in the IOMesh cluster. |
| Total Storage Capacity | Shows the total storage capacity of the IOMesh cluster. |
| Used Storage Capacity | Shows the used storage capacity of the IOMesh cluster. |
| Total Storage Capacity Usage | Shows the percentage of used storage capacity to total storage capacity of the IOMesh cluster. |
| Data Migrate & Recovery | Shows the amount of data to be migrated and migration speed, or the amount of all data to be recovered and recovery speed. |
| Cluster IOPS | Shows the minimum, maximum and latest values of read, write and total IOPS for the IOMesh cluster in a given time period, respectively. |
| Cluster Average Latency | Shows the minimum, maximum, and latest values of read, write, and total average latency for the IOMesh cluster in a given time period, respectively. |
| Cluster I/O Average Block Size | Shows the minimum, maximum, and latest values of read, write, and total average block size for the IOMesh cluster in a given time period, respectively. |
| Cluster I/O Bandwidth | Shows the minimum, maximum, and latest values of read, write, and total bandwidth for the IOMesh cluster in a given time period, respectively. |
Node
Shows the basic information of each node in the IOMesh cluster.
| Field | Description | Example |
|---|---|---|
| Name | The node name. | "node-1" |
| Namespace | The namespace where the node is located. | "iomesh-system" |
| Health Status | Shows node health status, including Initializing, Healthy, and Error. | "Healthy" |
| Storage Capacity | The total storage capacity of the node. | "2.0 TiB" |
| Storage Capacity Usage | The storage space usage of the node. | "20.0%" |
| Dirty Cache | The dirty data space of the node. | "5.0 GiB" |
| Cache Hit | Node read cache hit ratio * read ratio + write cache hit ratio * write ratio. | "70.0%" |
| Overall IOPS | The total IOPS of the node. | "500.0 io/s" |
| Avg Latency | The average read and write latency of the node. | "1.0 us" |
| Migrate | The data migration speed for the node. | "1000.0 B/s" |
| Recovery | The data recovery speed for the node. | "1000.0 B/s" |
Details of Node
Shows data migration, recovery, and performance data of a specific node in the IOMesh cluster.
| Field | Description | Example |
|---|---|---|
| Pending Migrate | The amount of data to be migrated on the node. | "50.0 MiB" |
| Pending Recover | The amount of data to be recovered on the node. | "50.0 MiB" |
| Invalid Cache Capacity | The amount of unavailable cache space on the node. | "50.0 MiB" |
| Invalid Storage Capacity | The amount of unavailable data space on the node. | "50.0 MiB" |
| Node IOPS | Shows the minimum, maximum, and latest values of read write IOPS in a given time period. | / |
| Node Average Latency | Shows the minimum, maximum, and latest values of read write average latency in a given time period. | / |
| Node I/O Average Block Size | Shows the minimum, maximum, and latest values of read write average block size in a given time period. | / |
| Node I/O Bandwidth | Shows the minimum, maximum, and latest values of read write bandwidth in a given time period. | / |
Physical Disk
Shows disk attribute information, health and usage status, and purpose of use.
| Field | Description | Example |
|---|---|---|
| Device Name | The physical disk name. | "dev/sdv" |
| Health Status | Shows the health status of the physical disk, including
| "Healthy" |
| Usage Status | Shows if the usage status of the physical disk, including Unmounted, Partially mounted, Mounted, and Unmounting. | "Mounted" |
| Remaining Lifetime | Shows the remaining life of SSD. A higher percentage (%) value indicates a longer remaining life. | "99%" |
| Type | Shows the disk type, including SSD and HDD. | "HDD" |
| Model | Shows disk attribute information, which may contain brand information. | "DL2400MM0159" |
| Serial Number | The serial number of the physical disk. | "WBM3C4TE" |
| Use | Shows the purpose of the physical disk, including Datastore, Cache with journal, and Datastore with journal. | "Datastore" |
| Capacity | The total capacity of the physical disk. | "500 GiB" |
| Nodename | The node where the disk is located. | "node-1" |
Persistent Volume
Shows the attribute information, status, and usage of a PV in the IOMesh cluster.
| Field | Description | Example |
|---|---|---|
| Name | The PV name. | "Volume-1" |
| StorageClass | The StorageClass of this PV. | "StorageClass1" |
| Status | Shows the PV status, including:
| "Available" |
| Allocated Capacity | The logical capacity allocated to this PV. | "50 GiB" |
| Exclusive Capacity | The logical capacity exclusive for this PV. | "25 GiB" |
| Shared Capacity | The physical capacity shared by this PV and other objects. | "10 GiB" |
| PV Provisioning | Shows the PV provisioning type, including Thin provisioning and Thick provisioning. | "Thin provisioning" |
| Replicas | The number of replicas for this PV, either 2 or 3. | "2" |
| Created Time | The time when this PV was created. | "2022-12-08 14:45:00" |