Raid: Difference between revisions

From CLONWiki
Jump to navigation Jump to search
Boiarino (talk | contribs)
Boiarino (talk | contribs)
No edit summary
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
== storcli ==
== '''storcli''' ==


On clondaq7, it is installed to ''/opt/MegaRAID/storcli''.
On clondaq7, it is installed to ''/opt/MegaRAID/storcli''.
Line 75: Line 75:
   0 Migrate          0 In progress 20 Days 23 Hours 57 Minutes  
   0 Migrate          0 In progress 20 Days 23 Hours 57 Minutes  
  ---------------------------------------------------------------
  ---------------------------------------------------------------
To speed up, reconstruction rate can be increased:
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate
/opt/MegaRAID/storcli/storcli64 /c0 set reconrate=90
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate


Check again in one hour, it will update estimate time to more realistic value.
Check again in one hour, it will update estimate time to more realistic value.
Line 82: Line 87:
  /opt/MegaRAID/storcli/storcli64 /c0/v0 start cc
  /opt/MegaRAID/storcli/storcli64 /c0/v0 start cc


== perccli ==
 
New disk may need to be formatted before adding to array, for example if PI=Y. For example for the disk shown as
 
9:21    36 Ugood  - 7.277 TB SAS  HDD N  Y  512B HUH721008AL5200  U  -
 
do following:
 
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show all | grep -iE "SN =|WWN =|Sector|PI|Sanitize|Erase|JBOD" # show various parameters
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod                                                      # convert drive 9:21 from UGood to JBOD so Linux sees its /dev/sgX node
lsscsi -g && ls -l /dev/disk/by-id/ | grep -i "wwn-"                                                      # Identify the exact /dev/sgX device matching 9:21's Serial Number / WWN
sg_format --format --size=512 --fmtpinfo=0 --pfu=0 -v /dev/sg6                                            # formating, may take hours
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force                                                # convert drive back to UGood
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show                                                          # verify PI is now N
 
If PI still Y, try this:
 
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod
sg_readcap -l /dev/sg6
 
If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet. Try this:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spindown
sleep 5
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spinup
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show
 
If PI still Y, pull drive off, wait for 10 seconds, and insert it back, it should force re-reading of the updated geometry.
 
'''NOTE:''' to visually locate drive, use LED on it; it can be activated with following commands:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 start locate
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 stop locate
 
== '''perccli''' ==


On clondaq6, it is installed in ''/opt/MegaRAID/perccli'' (from rpm inside ''/usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz'').
On clondaq6, it is installed in ''/opt/MegaRAID/perccli'' (from rpm inside ''/usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz'').

Latest revision as of 09:45, 19 November 2026

storcli

On clondaq7, it is installed to /opt/MegaRAID/storcli.

./storcli64 /c0/eall/sall show
CLI Version = 007.3405.0000.0000 May 15, 2025
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64
Controller = 0
Status = Success
Description = Show Drive Information Succeeded.


Drive Information :
=================

----------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model            Sp Type 
----------------------------------------------------------------------------
9:0      10 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:1      18 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:2      14 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:3      20 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:4      23 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:5      32 Onln   0 7.276 TB SAS  HDD N   N  512B HUH728080AL5204  U  -    
9:6      28 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:7      25 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:8      11 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:9      13 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:10     31 GHS    - 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:11     16 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:12     24 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:13     26 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:14     15 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:15     19 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:16     22 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:17     29 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:18     27 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:19     21 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:20     33 Onln   - 7.276 TB SAS  HDD N   N  512B HUH728080AL5204  U  -    
9:21     34 UGood  - 7.276 TB SAS  HDD N   N  512B HUH728080AL5204  D  -    
----------------------------------------------------------------------------

Useful command:

/opt/MegaRAID/storcli/storcli64 /c0/v0 show all
/opt/MegaRAID/storcli/storcli64 /c0/vall show

To add Ugood disk to v0 raid, first check active operations: if any, you cannot add new disk:

/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations"
Active Operations = Consistency Check (52%)

Do following:

/opt/MegaRAID/storcli/storcli64 /c0 set cc=off # disable consistency check (have to disable any active operations ?)
/opt/MegaRAID/storcli/storcli64 /c0/v0 stop cc # stop consistency check
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations" # it should be 'NONE' active operations
/opt/MegaRAID/storcli/storcli64 /c0/v0 start migrate type=raid6 option=add drives=9:20 # add disk to raid array
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate # show migration status
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate
CLI Version = 007.3405.0000.0000 May 15, 2025
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64
Controller = 0
Status = Success
Description = None


VD Operation Status :
===================

---------------------------------------------------------------
VD Operation Progress% Status      Estimated Time Left         
---------------------------------------------------------------
 0 Migrate           0 In progress 20 Days 23 Hours 57 Minutes 
---------------------------------------------------------------

To speed up, reconstruction rate can be increased:

/opt/MegaRAID/storcli/storcli64 /c0 show reconrate
/opt/MegaRAID/storcli/storcli64 /c0 set reconrate=90
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate

Check again in one hour, it will update estimate time to more realistic value.

NOTE: after all done (migration reaches 100%), do not forget to re-enable and start consistency check !!!

/opt/MegaRAID/storcli/storcli64 /c0 set cc=cons
/opt/MegaRAID/storcli/storcli64 /c0/v0 start cc


New disk may need to be formatted before adding to array, for example if PI=Y. For example for the disk shown as

9:21     36 Ugood   - 7.277 TB SAS  HDD N   Y  512B HUH721008AL5200  U  -

do following:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show all | grep -iE "SN =|WWN =|Sector|PI|Sanitize|Erase|JBOD" # show various parameters
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod                                                       # convert drive 9:21 from UGood to JBOD so Linux sees its /dev/sgX node
lsscsi -g && ls -l /dev/disk/by-id/ | grep -i "wwn-"                                                      # Identify the exact /dev/sgX device matching 9:21's Serial Number / WWN
sg_format --format --size=512 --fmtpinfo=0 --pfu=0 -v /dev/sg6                                            # formating, may take hours
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force                                                 # convert drive back to UGood
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show                                                           # verify PI is now N

If PI still Y, try this:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod
sg_readcap -l /dev/sg6

If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet. Try this:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spindown
sleep 5
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spinup
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show

If PI still Y, pull drive off, wait for 10 seconds, and insert it back, it should force re-reading of the updated geometry.

NOTE: to visually locate drive, use LED on it; it can be activated with following commands:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 start locate
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 stop locate

perccli

On clondaq6, it is installed in /opt/MegaRAID/perccli (from rpm inside /usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz).

Commands similar to storcli, for example:

[root@clondaq6 perccli]# ./perccli64 /c0/eall/sall show
CLI Version = 007.1910.0000.0000 Oct 08, 2021
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64
Controller = 0
Status = Success
Description = Show Drive Information Succeeded.


Drive Information :
=================

----------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model            Sp Type 
----------------------------------------------------------------------------
32:0      0 Onln   0 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:1      1 Onln   0 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:2      2 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:3      3 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:4      4 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:5      5 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:6      6 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:7      7 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:8      8 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:9      9 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:10    10 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:11    11 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:12    12 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:13    13 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:14    14 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:15    15 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:16    16 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:17    17 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:18    18 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:19    19 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:20    20 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:21    21 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:22    22 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:23    23 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
----------------------------------------------------------------------------

EID=Enclosure Device ID|Slt=Slot No|DID=Device ID|DG=DriveGroup
DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare
UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface
Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info
SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign
UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded
CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded
UBUnsp=UBad Unsupported|Rbld=Rebuild