So, you replaced a faulted disk, but the old one is still present in the GUI and it is listed as “removed”. Node ecs-05 has one unknown disk.
admin@ecs-05:~> fcli disks list
AGENT ID HOSTNAME SERVICE DISK TYPE STORAGE NAME FORMAT GOOD BAD SUSPECT UNKNOWN
2a5551e7-bb7a-4068-8227-fd595c022670 ecs-01 object-main 8001GB HDD DATA XFS 30 0 0 0
f7f9b8ff-af2b-4b38-9401-7b7328a5f2f2 ecs-02 object-main 8001GB HDD DATA XFS 30 0 0 0
ae517c39-c16e-4d32-9311-0f18553d1849 ecs-03 object-main 8001GB HDD DATA XFS 30 0 0 0
7435e43a-11d0-44f8-859f-e0a7a1be5891 ecs-04 object-main 8001GB HDD DATA XFS 30 0 0 0
392f7a11-dac4-43aa-a92a-787ff9e12068 ecs-05 object-main 8001GB HDD DATA XFS 30 0 0 1
9b005f9d-5a65-464c-af4e-4d891aa87d4a ecs-06 object-main 8001GB HDD DATA XFS 30 0 0 0
8a0aa1ef-1337-43dc-b60f-c1f47f2564db ecs-07 object-main 8001GB HDD DATA XFS 30 0 0 0
d422ec5b-6050-4f92-9ef5-940cdba96b80 ecs-08 object-main 8001GB HDD DATA XFS 30 0 0 0
Here it is what you have to do.
On the affected node, run the following command to display all disks:
admin@ecs-05:~> sudo /opt/emc/caspian/fabric/cli/bin/fcli agent disk.disks
This will return a JSON with all disks and a lot of info about them. You should look for the disk with status UNMOUNTED or health UNKNOWN or operational status MISSING. For that particular disk, remember its UUID. We will need it further. Look also for the slot number. This one is A00. We should also look for the new disk, which is also in slot A00 and grab its UUID. In the output below I highlighted all the lines that have useful info for us.
{
"disks" : [
{
"capacity_gb" : 8001,
"device" : "/dev/sdc",
"drive_id" : {
"product_id" : "H04728T8CLAR8000",
"serial_number" : "VDHJKVSF",
"vendor_id" : "HITACHI"
},
"endurance" : -1,
"firmware" : "A430",
"format" : "XFS",
"health" : "GOOD",
"mount_path" : "/dae/uuid-b1d53734-16a2-4fcb-aaa4-c2a8084b13b4",
"mount_status" : "MOUNTED",
"operational_status" : "OPERATIVE",
"owner" : "object",
"reason" : "Disk is operative.",
"slot" : "A00",
"storage_class" : "HDD",
"storage_name" : "DATA",
"uuid" : "b1d53734-16a2-4fcb-aaa4-c2a8084b13b4"
},
{
"capacity_gb" : 8001,
"device" : "/dev/sdal",
"drive_id" : {
"product_id" : "H0H72108CLAR8000",
"serial_number" : "7SJ13ENU",
"vendor_id" : "HITACHI"
},
"endurance" : -1,
"firmware" : "P290",
"format" : "XFS",
"health" : "UNKNOWN",
"mount_path" : "/dae/uuid-411b377b-0566-48b0-b3e2-9c90ba929d78",
"mount_status" : "UNMOUNTED",
"operational_status" : "MISSING",
"owner" : "object",
"reason" : "System does not detect the disk. Contact your service provider.",
"slot" : "A00",
"storage_class" : "HDD",
"storage_name" : "DATA",
"uuid" : "411b377b-0566-48b0-b3e2-9c90ba929d78"
},
{
"capacity_gb" : 8001,
"device" : "/dev/sdbc",
"drive_id" : {
"product_id" : "H0H72108CLAR8000",
"serial_number" : "7SJ0VZ5U",
"vendor_id" : "HITACHI"
},
"endurance" : -1,
"firmware" : "P290",
"format" : "XFS",
"health" : "GOOD",
"mount_path" : "/dae/uuid-42c5706e-6e35-44c5-af33-0e0e3577dcc1",
"mount_status" : "MOUNTED",
"operational_status" : "OPERATIVE",
"owner" : "object",
"reason" : "Disk is operative.",
"slot" : "A11",
"storage_class" : "HDD",
"storage_name" : "DATA",
"uuid" : "42c5706e-6e35-44c5-af33-0e0e3577dcc1"
},
],
"etag" : 919185,
"status" : "OK"
}
Now, let’s remove the old disk, using the command sudo /opt/emc/caspian/fabric/cli/bin/fcli disks remove –diskid <old-disk-uuid> –force
admin@ecs-05:~> sudo /opt/emc/caspian/fabric/cli/bin/fcli disks remove --diskid 411b377b-0566-48b0-b3e2-9c90ba929d78 --force
disk 411b377b-0566-48b0-b3e2-9c90ba929d78 removed successfully
And add the new disk using the command sudo /opt/emc/caspian/fabric/cli/bin/fcli agent disk.add –disk <new-disk-uuid>
admin@ecs-05:~> sudo /opt/emc/caspian/fabric/cli/bin/fcli agent disk.add --disk b1d53734-16a2-4fcb-aaa4-c2a8084b13b4
{
"etag" : 919188,
"status" : "OK"
}
Now you can run again sudo /opt/emc/caspian/fabric/cli/bin/fcli agent disk.disks and you will see that no disk exists anymore with status UNMOUNTED or UNKNOWN.
admin@ecs-05:~> fcli disks list
AGENT ID HOSTNAME SERVICE DISK TYPE STORAGE NAME FORMAT GOOD BAD SUSPECT UNKNOWN
2a5551e7-bb7a-4068-8227-fd595c022670 ecs-01 object-main 8001GB HDD DATA XFS 30 0 0 0
f7f9b8ff-af2b-4b38-9401-7b7328a5f2f2 ecs-02 object-main 8001GB HDD DATA XFS 30 0 0 0
ae517c39-c16e-4d32-9311-0f18553d1849 ecs-03 object-main 8001GB HDD DATA XFS 30 0 0 0
7435e43a-11d0-44f8-859f-e0a7a1be5891 ecs-04 object-main 8001GB HDD DATA XFS 30 0 0 0
392f7a11-dac4-43aa-a92a-787ff9e12068 ecs-05 object-main 8001GB HDD DATA XFS 30 0 0 0
9b005f9d-5a65-464c-af4e-4d891aa87d4a ecs-06 object-main 8001GB HDD DATA XFS 30 0 0 0
8a0aa1ef-1337-43dc-b60f-c1f47f2564db ecs-07 object-main 8001GB HDD DATA XFS 30 0 0 0
d422ec5b-6050-4f92-9ef5-940cdba96b80 ecs-08 object-main 8001GB HDD DATA XFS 30 0 0 0
