Raid: Difference between revisions

From CLONWiki
Jump to navigation Jump to search
Boiarino (talk | contribs)
Boiarino (talk | contribs)
No edit summary
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
== storcli ==
== '''storcli''' ==


On clondaq7, it is installed to ''/opt/MegaRAID/storcli''.
On clondaq7, it is installed to ''/opt/MegaRAID/storcli''.
Line 106: Line 106:
  sg_readcap -l /dev/sg6
  sg_readcap -l /dev/sg6


If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet.
If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet. Try this:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spindown
sleep 5
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spinup
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show


== perccli ==
If PI still Y, pull drive off, wait for 10 seconds, and insert it back, it should force re-reading of the updated geometry.
 
'''NOTE:''' to visually locate drive, use LED on it; it can be activated with following commands:
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 start locate
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 stop locate
 
== '''perccli''' ==


On clondaq6, it is installed in ''/opt/MegaRAID/perccli'' (from rpm inside ''/usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz'').
On clondaq6, it is installed in ''/opt/MegaRAID/perccli'' (from rpm inside ''/usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz'').

Latest revision as of 09:45, 19 November 2026

storcli

On clondaq7, it is installed to /opt/MegaRAID/storcli.

./storcli64 /c0/eall/sall show
CLI Version = 007.3405.0000.0000 May 15, 2025
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64
Controller = 0
Status = Success
Description = Show Drive Information Succeeded.


Drive Information :
=================

----------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model            Sp Type 
----------------------------------------------------------------------------
9:0      10 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:1      18 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:2      14 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:3      20 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:4      23 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:5      32 Onln   0 7.276 TB SAS  HDD N   N  512B HUH728080AL5204  U  -    
9:6      28 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:7      25 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:8      11 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:9      13 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:10     31 GHS    - 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:11     16 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:12     24 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:13     26 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:14     15 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:15     19 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:16     22 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:17     29 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:18     27 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:19     21 Onln   0 7.276 TB SAS  HDD N   N  512B HUH721008AL5200  U  -    
9:20     33 Onln   - 7.276 TB SAS  HDD N   N  512B HUH728080AL5204  U  -    
9:21     34 UGood  - 7.276 TB SAS  HDD N   N  512B HUH728080AL5204  D  -    
----------------------------------------------------------------------------

Useful command:

/opt/MegaRAID/storcli/storcli64 /c0/v0 show all
/opt/MegaRAID/storcli/storcli64 /c0/vall show

To add Ugood disk to v0 raid, first check active operations: if any, you cannot add new disk:

/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations"
Active Operations = Consistency Check (52%)

Do following:

/opt/MegaRAID/storcli/storcli64 /c0 set cc=off # disable consistency check (have to disable any active operations ?)
/opt/MegaRAID/storcli/storcli64 /c0/v0 stop cc # stop consistency check
/opt/MegaRAID/storcli/storcli64 /c0/v0 show all | grep "Active Operations" # it should be 'NONE' active operations
/opt/MegaRAID/storcli/storcli64 /c0/v0 start migrate type=raid6 option=add drives=9:20 # add disk to raid array
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate # show migration status
/opt/MegaRAID/storcli/storcli64 /c0/v0 show migrate
CLI Version = 007.3405.0000.0000 May 15, 2025
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64
Controller = 0
Status = Success
Description = None


VD Operation Status :
===================

---------------------------------------------------------------
VD Operation Progress% Status      Estimated Time Left         
---------------------------------------------------------------
 0 Migrate           0 In progress 20 Days 23 Hours 57 Minutes 
---------------------------------------------------------------

To speed up, reconstruction rate can be increased:

/opt/MegaRAID/storcli/storcli64 /c0 show reconrate
/opt/MegaRAID/storcli/storcli64 /c0 set reconrate=90
/opt/MegaRAID/storcli/storcli64 /c0 show reconrate

Check again in one hour, it will update estimate time to more realistic value.

NOTE: after all done (migration reaches 100%), do not forget to re-enable and start consistency check !!!

/opt/MegaRAID/storcli/storcli64 /c0 set cc=cons
/opt/MegaRAID/storcli/storcli64 /c0/v0 start cc


New disk may need to be formatted before adding to array, for example if PI=Y. For example for the disk shown as

9:21     36 Ugood   - 7.277 TB SAS  HDD N   Y  512B HUH721008AL5200  U  -

do following:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show all | grep -iE "SN =|WWN =|Sector|PI|Sanitize|Erase|JBOD" # show various parameters
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod                                                       # convert drive 9:21 from UGood to JBOD so Linux sees its /dev/sgX node
lsscsi -g && ls -l /dev/disk/by-id/ | grep -i "wwn-"                                                      # Identify the exact /dev/sgX device matching 9:21's Serial Number / WWN
sg_format --format --size=512 --fmtpinfo=0 --pfu=0 -v /dev/sg6                                            # formating, may take hours
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force                                                 # convert drive back to UGood
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show                                                           # verify PI is now N

If PI still Y, try this:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set jbod
sg_readcap -l /dev/sg6

If prot_en=0, the low-level format succeeded! StorCLI simply hasn't refreshed its cached drive properties yet. Try this:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 set good force
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spindown
sleep 5
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 spinup
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 show

If PI still Y, pull drive off, wait for 10 seconds, and insert it back, it should force re-reading of the updated geometry.

NOTE: to visually locate drive, use LED on it; it can be activated with following commands:

/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 start locate
/opt/MegaRAID/storcli/storcli64 /c0/e9/s21 stop locate

perccli

On clondaq6, it is installed in /opt/MegaRAID/perccli (from rpm inside /usr/downloads/PERCCLI_7.1910.00_A12_Linux.tar.gz).

Commands similar to storcli, for example:

[root@clondaq6 perccli]# ./perccli64 /c0/eall/sall show
CLI Version = 007.1910.0000.0000 Oct 08, 2021
Operating system = Linux 5.14.0-611.7.1.el9_7.x86_64
Controller = 0
Status = Success
Description = Show Drive Information Succeeded.


Drive Information :
=================

----------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model            Sp Type 
----------------------------------------------------------------------------
32:0      0 Onln   0 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:1      1 Onln   0 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:2      2 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:3      3 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:4      4 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:5      5 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:6      6 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:7      7 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:8      8 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:9      9 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:10    10 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:11    11 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:12    12 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:13    13 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:14    14 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:15    15 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:16    16 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:17    17 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:18    18 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:19    19 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:20    20 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:21    21 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:22    22 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
32:23    23 Onln   1 1.090 TB SAS  HDD N   N  512B HUC101212CSS600  U  -    
----------------------------------------------------------------------------

EID=Enclosure Device ID|Slt=Slot No|DID=Device ID|DG=DriveGroup
DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare
UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface
Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info
SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign
UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded
CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded
UBUnsp=UBad Unsupported|Rbld=Rebuild