Raid: Difference between revisions
No edit summary |
|||
| (14 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
== storcli | == '''storcli''' == | ||
On clondaq7, it is installed to ''/opt/MegaRAID/storcli''. | |||
./storcli64 /c0/eall/sall show | '''./storcli64 /c0/eall/sall show''' | ||
CLI Version = 007.3405.0000.0000 May 15, 2025 | CLI Version = 007.3405.0000.0000 May 15, 2025 | ||
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 | Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 | ||
| Line 40: | Line 40: | ||
9:21 34 UGood - 7.276 TB SAS HDD N N 512B HUH728080AL5204 D - | 9:21 34 UGood - 7.276 TB SAS HDD N N 512B HUH728080AL5204 D - | ||
---------------------------------------------------------------------------- | ---------------------------------------------------------------------------- | ||
Useful command: | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | |||
/opt/MegaRAID/storcli/storcli64 /c0/vall show | |||
To add Ugood disk to v0 raid, first check active operations: if any, you cannot add new disk: | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations" | |||
Active Operations = Consistency Check (52%) | |||
Do following: | |||
/opt/MegaRAID/storcli/storcli64 /c0 set cc=off # disable consistency check (have to disable any active operations ?) | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 stop cc # stop consistency check | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations" # it should be 'NONE' active operations | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 start migrate type=raid6 option=add drives=9:20 # add disk to raid array | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate # show migration status | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate | |||
CLI Version = 007.3405.0000.0000 May 15, 2025 | |||
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 | |||
Controller = 0 | |||
Status = Success | |||
Description = None | |||
VD Operation Status : | |||
=================== | |||
--------------------------------------------------------------- | |||
VD Operation Progress% Status Estimated Time Left | |||
--------------------------------------------------------------- | |||
0 Migrate 0 In progress 20 Days 23 Hours 57 Minutes | |||
--------------------------------------------------------------- | |||
To speed up, reconstruction rate can be increased: | |||
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate | |||
/opt/MegaRAID/storcli/storcli64 /c0 set reconrate=90 | |||
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate | |||
Check again in one hour, it will update estimate time to more realistic value. | |||
'''NOTE: after all done (migration reaches 100%), do not forget to re-enable and start consistency check !!!''' | |||
/opt/MegaRAID/storcli/storcli64 /c0 set cc=cons | |||
/opt/MegaRAID/storcli/storcli64 /c0/v0 start cc | |||
New disk may need to be formatted before adding to array, for example if PI=Y. For example for the disk shown as | |||
9:21 36 Ugood - 7.277 TB SAS HDD N Y 512B HUH721008AL5200 U - | |||
do following: | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show all | grep -iE "SN =|WWN =|Sector|PI|Sanitize|Erase|JBOD" # show various parameters | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod # convert drive 9:21 from UGood to JBOD so Linux sees its /dev/sgX node | |||
lsscsi -g && ls -l /dev/disk/by-id/ | grep -i "wwn-" # Identify the exact /dev/sgX device matching 9:21's Serial Number / WWN | |||
sg_format --format --size=512 --fmtpinfo=0 --pfu=0 -v /dev/sg6 # formating, may take hours | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force # convert drive back to UGood | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show # verify PI is now N | |||
If PI still Y, try this: | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod | |||
sg_readcap -l /dev/sg6 | |||
If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet. Try this: | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spindown | |||
sleep 5 | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spinup | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show | |||
If PI still Y, pull drive off, wait for 10 seconds, and insert it back, it should force re-reading of the updated geometry. | |||
'''NOTE:''' to visually locate drive, use LED on it; it can be activated with following commands: | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 start locate | |||
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 stop locate | |||
== '''perccli''' == | |||
On clondaq6, it is installed in ''/opt/MegaRAID/perccli'' (from rpm inside ''/usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz''). | |||
Commands similar to storcli, for example: | |||
[root@clondaq6 perccli]# '''./perccli64 /c0/eall/sall show''' | |||
CLI Version = 007.1910.0000.0000 Oct 08, 2021 | |||
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 | |||
Controller = 0 | |||
Status = Success | |||
Description = Show Drive Information Succeeded. | |||
Drive Information : | |||
================= | |||
---------------------------------------------------------------------------- | |||
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type | |||
---------------------------------------------------------------------------- | |||
32:0 0 Onln 0 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:1 1 Onln 0 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:2 2 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:3 3 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:4 4 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:5 5 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:6 6 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:7 7 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:8 8 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:9 9 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:10 10 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:11 11 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:12 12 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:13 13 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:14 14 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:15 15 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:16 16 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:17 17 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:18 18 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:19 19 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:20 20 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:21 21 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:22 22 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
32:23 23 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - | |||
---------------------------------------------------------------------------- | |||
EID=Enclosure Device ID|Slt=Slot No|DID=Device ID|DG=DriveGroup | |||
DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare | |||
UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface | |||
Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info | |||
SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign | |||
UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded | |||
CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded | |||
UBUnsp=UBad Unsupported|Rbld=Rebuild | |||
Latest revision as of 09:45, 19 November 2026
storcli
On clondaq7, it is installed to /opt/MegaRAID/storcli.
./storcli64 /c0/eall/sall show CLI Version = 007.3405.0000.0000 May 15, 2025 Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 Controller = 0 Status = Success Description = Show Drive Information Succeeded. Drive Information : ================= ---------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ---------------------------------------------------------------------------- 9:0 10 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:1 18 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:2 14 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:3 20 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:4 23 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:5 32 Onln 0 7.276 TB SAS HDD N N 512B HUH728080AL5204 U - 9:6 28 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:7 25 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:8 11 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:9 13 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:10 31 GHS - 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:11 16 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:12 24 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:13 26 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:14 15 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:15 19 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:16 22 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:17 29 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:18 27 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:19 21 Onln 0 7.276 TB SAS HDD N N 512B HUH721008AL5200 U - 9:20 33 Onln - 7.276 TB SAS HDD N N 512B HUH728080AL5204 U - 9:21 34 UGood - 7.276 TB SAS HDD N N 512B HUH728080AL5204 D - ----------------------------------------------------------------------------
Useful command:
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all /opt/MegaRAID/storcli/storcli64 /c0/vall show
To add Ugood disk to v0 raid, first check active operations: if any, you cannot add new disk:
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations" Active Operations = Consistency Check (52%)
Do following:
/opt/MegaRAID/storcli/storcli64 /c0 set cc=off # disable consistency check (have to disable any active operations ?) /opt/MegaRAID/storcli/storcli64 /c0/v0 stop cc # stop consistency check /opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations" # it should be 'NONE' active operations /opt/MegaRAID/storcli/storcli64 /c0/v0 start migrate type=raid6 option=add drives=9:20 # add disk to raid array /opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate # show migration status
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate CLI Version = 007.3405.0000.0000 May 15, 2025 Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 Controller = 0 Status = Success Description = None VD Operation Status : =================== --------------------------------------------------------------- VD Operation Progress% Status Estimated Time Left --------------------------------------------------------------- 0 Migrate 0 In progress 20 Days 23 Hours 57 Minutes ---------------------------------------------------------------
To speed up, reconstruction rate can be increased:
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate /opt/MegaRAID/storcli/storcli64 /c0 set reconrate=90 /opt/MegaRAID/storcli/storcli64 /c0 show reconrate
Check again in one hour, it will update estimate time to more realistic value.
NOTE: after all done (migration reaches 100%), do not forget to re-enable and start consistency check !!!
/opt/MegaRAID/storcli/storcli64 /c0 set cc=cons /opt/MegaRAID/storcli/storcli64 /c0/v0 start cc
New disk may need to be formatted before adding to array, for example if PI=Y. For example for the disk shown as
9:21 36 Ugood - 7.277 TB SAS HDD N Y 512B HUH721008AL5200 U -
do following:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show all | grep -iE "SN =|WWN =|Sector|PI|Sanitize|Erase|JBOD" # show various parameters /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod # convert drive 9:21 from UGood to JBOD so Linux sees its /dev/sgX node lsscsi -g && ls -l /dev/disk/by-id/ | grep -i "wwn-" # Identify the exact /dev/sgX device matching 9:21's Serial Number / WWN sg_format --format --size=512 --fmtpinfo=0 --pfu=0 -v /dev/sg6 # formating, may take hours /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force # convert drive back to UGood /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show # verify PI is now N
If PI still Y, try this:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod sg_readcap -l /dev/sg6
If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet. Try this:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spindown sleep 5 /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spinup /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show
If PI still Y, pull drive off, wait for 10 seconds, and insert it back, it should force re-reading of the updated geometry.
NOTE: to visually locate drive, use LED on it; it can be activated with following commands:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 start locate /opt/MegaRAID/storcli/storcli64 /c0/e9/s21 stop locate
perccli
On clondaq6, it is installed in /opt/MegaRAID/perccli (from rpm inside /usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz).
Commands similar to storcli, for example:
[root@clondaq6 perccli]# ./perccli64 /c0/eall/sall show CLI Version = 007.1910.0000.0000 Oct 08, 2021 Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64 Controller = 0 Status = Success Description = Show Drive Information Succeeded. Drive Information : ================= ---------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ---------------------------------------------------------------------------- 32:0 0 Onln 0 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:1 1 Onln 0 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:2 2 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:3 3 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:4 4 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:5 5 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:6 6 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:7 7 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:8 8 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:9 9 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:10 10 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:11 11 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:12 12 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:13 13 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:14 14 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:15 15 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:16 16 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:17 17 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:18 18 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:19 19 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:20 20 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:21 21 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:22 22 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - 32:23 23 Onln 1 1.090 TB SAS HDD N N 512B HUC101212CSS600 U - ---------------------------------------------------------------------------- EID=Enclosure Device ID|Slt=Slot No|DID=Device ID|DG=DriveGroup DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded UBUnsp=UBad Unsupported|Rbld=Rebuild