Data collectie ODA and Exadata

To collect information on the disk issues the following can be used:

/root/Extras/odasundiag.sh

oakcli stordiag e#_pd_S#        < where e# is enclosure 0 or 1 and S# is Slot number  *

for ODA X3-2, X4-2 or X5-2

oakcli stordiag e0_pd_02                  and if the disk is the SECOND JBOD use  e1_pd_02

for V1 ODA

oakcli stordiag pd_02

SP Collects using CLI

Using navicli or naviseccli

/opt/Navisphere/bin/naviseccli -h <ipaddress> spcollect

/opt/Navisphere/bin/naviseccli -h <ipaddress> managefiles -list

/opt/Navisphere/bin/naviseccli -h <ipaddress> managefiles -retrieve -file <filename just created>

Posted in EMC

Compare ALOM and ILOM commands

ALOM CMT Command
Summary
Comparable ILOM Command
password
Changes the login password of the current user.
set /SP/users/username password
restartssh
Restarts the SSH server so that new host keys generated by the ssh-keygen command are reloaded.
set /SP/services/ssh restart_sshd_action=true
setdate [[mmdd]HHMM |mmddHHMM[cc]yy][.SS]
Sets ALOM CMT date and time.
set /SP/clock datetime=value
setdefaults [–a]
Resets all ALOM CMT configuration parameters to their default values. The –a option resets the user information to the default (one admin account only).
set /SP reset_to_defaults=[none|factory|all]
setkeyswitch [normal|stby|diag| locked]
Sets the status of the virtual keyswitch. Setting the virtual keyswitch to standby (stby) powers off the server. Before powering off the host server, ALOM CMT asks for a confirmation.
set /SYS keyswitch_state=value
setsc [param] [value]
Sets the specified ALOM CMT parameter to the assigned value.
set target property=value
setupsc
Runs the interactive configuration script. This script configures the ALOM CMT configuration variables.
No equivalent in ILOM
showplatform [–v]
Displays information about the host system’s hardware configuration, and whether the hardware is providing service. The –v option displays verbose information about the displayed components.
show /HOST
showfru
Displays information about the field-replaceable units (FRUs) in a host server.
Use the ILOM show [FRU] command to display static FRU information. (For dynamic FRU information, use the ALOM CMT showfru command.)
showusers –g lines
Displays a list of users currently logged in to ALOM CMT. The display for this command has a similar format to that of the UNIX command who. The –g option pauses the display after the number of lines you specify for lines.
show –level all –o table /SP/sessionsNo equivalent in ILOM for –g option

showhost version
Displays version information for host-side components. The version option displays the same information as the showhost command with no option.
show /HOST
showkeyswitch
Displays status of virtual keyswitch.
show /SYS keyswitch_state
showsc [param]
Displays the current nonvolatile random access memory (NVRAM) configuration parameters.
show target property
showdate
Displays the ALOM CMT date. ALOM CMT time is expressed in Coordinated Universal Time (UTC) rather than local time. The Solaris OS and ALOM CMT time are not synchronized.
show /SP/clock datetime
ssh-keygen –l ssh-keygen –r

ssh-keygen –t {rsa|dsa}

Generates Secure Shell (SSH) host keys and displays the host key fingerprint on the SC.
show /SP/services/ssh/keys rsa|dsaset /SP/services/ssh generate_new_key_action=true

set /SP/services/ssh generate_new_key_type=[rsa|dsa]

usershow [username]
Displays a list of all user accounts and permission levels, and whether passwords are assigned.
show /SP/users
useradd username
Adds a user account to ALOM CMT.
create /SP/users/username
userdel [–y] username
Deletes a user account from ALOM CMT. The –y option enables you to skip the confirmation question.
delete [–script] /SP/users/username
userpassword [username]
Sets or changes a user password.
set /SP/users/username password
userperm [username] [c] [u] [a] [r] [o] [s]
Sets the permission level for a user account.
set /SP/users/username role=permissions [a|u|c|r|o|s]

 

ALOM CMT Command
Summary
Comparable ILOM Command
showlogs -p [r|p] [–b lines|–e lines|–v] [–g lines]
Displays the history of all events logged in the event log, or major and critical events in the event log. The –p option selects whether to display only major and critical events from the event log (r) or to display all of the events from the event log (p).–g lines specifies the number of lines to display before pausing.

–e lines displays n lines from the end of the buffer.

–b lines displays n lines from the beginning of the buffer.

–v displays the entire buffer.

show /SP/logs/event/listNo equivalent in ILOM

consolehistory [–b lines|–e lines|–v] [–g lines] [boot|run]
Displays the host server console output buffers.–g lines specifies the number of lines to display before pausing.

–e lines displays n lines from the end of the buffer.

–b lines displays n lines from the beginning of the buffer.

–v displays the entire buffer.

set /SP/console/history property=value[set /SP/console/history property=value][set /SP/console/history property=value]

show /SP/console/history

where property can be:

line_count=[lines] default value is “” (none), meaning there is no limit to the total number of lines retrieved from the buffer.

pause_count=[count] default value is “” (none), meaning there is no limit to the count of lines displayed per pause.

start_from=[end|beginning] default value is end.

 

ALOM CMT Command
Summary
Comparable ILOM Command
showenvironment
Displays the environmental status of the host server. This information includes system temperatures, power supply status, front panel LED status, hard disk drive status, fan status, voltage, and current sensor status.
show –o table –level all /SYS
showpower [–v]
Displays power metrics for the host server.
show /SP/powermgmt
shownetwork [–v]
Displays the current network configuration information. The –v option shows additional information about your network, including information about your DHCP server.
show /SP/network
console [–f]
Connects to the host system console. The –f option forces the console write lock from one user to another.In ILOM, the –force option terminates the console, permitting you to start a new console.

start [–force] /SP/console
break [–D][–c]
Drops the host server from running the Solaris OS software into OpenBoot PROM or kmdb depending upon the mode in which the Solaris software was booted.
set /HOST send_break_action=[break|dumpcore][start /SP/console]

bootmode [normal] [reset_nvram] [config=configname][bootscript =string]
Controls the host server OpenBoot PROM firmware method of booting.
set /HOST/bootmode property=value(where property is state, config, or script)

flashupdate –s IPaddr –f pathname [–v] [–y] [–c]
Downloads and updates system firmware (both host firmware and ALOM CMT firmware). For ILOM, ipaddr must be a TFTP server. If you use DHCP, you can replace ipaddr with the name of the TFTP host.The –y option enables you to skip the confirmation question.

The –c option enables you to update system firmware on your server without preserving configuration information.

After configuration information has been deleted (by having used the –c option or the set /SP reset_to_defaults=factory command), you must use the –c option when replacing system firmware that includes ILOM 3.0 with firmware that includes ILOM 2.0. If you omit the –c option, the flashupdate command attempts to restore preserved configuration information, halting the firmware downgrade because that configuration information is absent.

load –source tftp://ipaddr/pathname
reset [–y] [–f] [–c]reset –d [–n] [–y] [–f] [–c]

Generates a hardware reset on the host server.The –y option enables you to skip the confirmation question.

The –f option forces a hardware reset.The –c option starts the console.

The –d option gracefully resets the control domain.The –n option sets the auto-boot variable to disable (lasts for one reset).The –y option enables you to skip the confirmation question.The –f option forces a hardware reset.The –c option starts the console.

reset [-script][–force] /SYS[start /SP/console]

[set /HOST/domain/control auto-boot=disable]

reset [–script] [–force] /HOST/domain/control

[start /SP/console]

powercycle [–y] [–f]
poweroff followed by poweron. The –f option forces an immediate poweroff, otherwise the command attempts a graceful shutdown.
stop [–script] [–force] /SYSstart [–script] [–force] /SYS

poweroff [–y][–f]
Removes the main power from the host server. The –y option enables you to skip the confirmation question. ALOM CMT attempts to shut the server down gracefully. The –f option forces an immediate shutdown.
stop [–script][–force] /SYS
poweron
Applies the main power to the host server or FRU.
start /SYS
setlocator [on/off]
Turns the Locator LED on the server on or off.
set /SYS/LOCATE value=value
showfaults [–v]
Displays current valid system faults.
show faulty
clearfault UUID
Manually repairs system faults. Use the ILOM show faulty command to identify faulted components.
set /SYS/component clear_fault_action=true
showlocator
Displays the current state of the Locator LED as either on or off.
show /SYS/LOCATE

 

ALOM CMT Command
Summary
Comparable ILOM Command
setfru –c data
The –c option enables you to store information (such as inventory codes) on all FRUs in a system.
set /SYS customer_frudata=data
showfru –g lines [–s|–d] [FRU]
Displays information about the FRUs in a host server.
show [FRU]
removefru [–y] [FRU]
Prepares a FRU (for example, a power supply) for removal. The –y option enables you to skip the confirmation question.
set /SYS/PS0 prepare_to_remove_action=true

 

ALOM CMT Command
Summary
Comparable ILOM Command
enablecomponent component
Re-enables a component that has been disabled using the disablecomponent command.
set /SYS/component component_state=enabled
disablecomponent component
Disables a component.
set /SYS/component component_state=disabled
showcomponent component
Displays system components and their test status.
show /SYS/component component_state
clearasrdb
Removes all entries from the list of disabled components.
No equivalent in ILOM

Table 29 ALOM CMT Shell Miscellaneous Commands

ALOM CMT Command
Summary
Comparable ILOM Command
help [command]
Displays a list of all ALOM CMT commands with their syntax and a brief description of how each command works. Specifying a command name as an option enables you to view the help for that command.
help
resetsc [–y]
Reboots ALOM CMT. The –y option enables you to skip the confirmation question.
reset [–script] /SP
userclimode username shelltype
Sets the type of shell to shelltype, where shelltype is default or alom.
set /SP/users/username cli_mode=shelltype
logout
Logs out from an ALOM CMT shell session.
exit

 

Cisco 6500 Module Status is PwrDown / PwrDeny

Module Status is Unknown / PwrDown

After a module was inserted, the status of this module shows up as Unknown in the show module command output.

This output shows the status of module WS-X6748-GE-TX as Unknown:

Switch#show module
Mod Ports Card Type Model Serial No.
— —– ————————————– —————— ———–
1 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX SAD09040FXH
2 48 CEF720 48 port 10/100/1000mb Ethernet WS-X6748-GE-TX SAD09050BT8
5 2 Supervisor Engine 720 (Active) WS-SUP720-3B SAD090406AF

Mod MAC addresses Hw Fw Sw Status
— ———————————- —— ———— ———— ——-
1 0011.bb2b.9b2c to 0011.bb2b.9b5b 2.1 Unknown Unknown PwrDown
2 0011.93d0.acb0 to 0011.93d0.acdf 2.1 12.2(14r)S5 12.2(18)SXD3 Ok
5 0011.21ba.b6c8 to 0011.21ba.b6cb 4.1 8.1(3) 12.2(18)SXD3 Ok

Mod Sub-Module Model Serial Hw Status
— ————————— —————— ———— ——- ——-
1 Centralized Forwarding Card WS-F6700-CFC SAL09051F61 2.0 PwrDown
2 Centralized Forwarding Card WS-F6700-CFC SAL09051F5F 2.0 Ok
5 Policy Feature Card 3 WS-F6K-PFC3B SAD090407MW 1.1 Ok
5 MSFC3 Daughterboard WS-SUP720 SAD090306XN 2.2 Ok

Mod Online Diag Status
— ——————-
1 Unknown
2 Pass
5 Pass
Switch#

When a module appears as Unknown on the show module command output, make sure you check these:

•The supervisor engine and the software it runs support the module.

•The specifications of the module. Make sure the module can be inserted in any slot or if it can only be inserted in specific slots.

Note: For both options, check the Release Notes of the software version that the supervisor engine runs.

Module Status is Unknown / PwrDeny

After you insert a module, the status of it is PwrDeny. If this is the case, check if there is enough power to turn on the module that appears as PwrDeny.

This output shows two modules with a status of Unknown / PwrDeny:

Switch#show module
Mod Ports Card Type Model Serial No.
— —– ————————————– —————— ———–
1 48 48 port 10/100 mb RJ45 WS-X6348-RJ-45 SAL062410XB
2 6 Firewall Module WS-SVC-FWM-1 SAD0918068W
3 6 Firewall Module WS-SVC-FWM-1 SAD090709TE
5 2 Supervisor Engine 720 (Active) WS-SUP720-BASE SAD090702NV
6 2 Supervisor Engine 720 (Hot) WS-SUP720-BASE SAD085105XN
7 48 CEF720 48 port 1000mb SFP WS-X6748-SFP SAL09148J7G
9 8 Intrusion Detection System WS-SVC-IDSM-2 SAD09180065

Mod MAC addresses Hw Fw Sw Status
— ———————————- —— ———— ———— ——-
1 0009.1279.5ef8 to 0009.1279.5f27 6.1 5.4(2) 8.3(0.110)TE Ok
2 0013.c301.1a44 to 0013.c301.1a4b 3.0 7.2(1) 2.3(1) Ok
3 0003.e472.940c to 0003.e472.9413 3.0 7.2(1) 1.1(4) Ok
5 0011.92e7.8a60 to 0011.92e7.8a63 3.2 8.1(3) 12.2(17d)SXB Ok
6 0011.21ba.9c4c to 0011.21ba.9c4f 3.2 8.1(3) 12.2(17d)SXB Ok
7 0013.7f97.d210 to 0013.7f97.d23f 1.4 Unknown Unknown PwrDeny
9 0013.8038.063c to 0013.8038.0643 5.0 Unknown Unknown PwrDeny

Mod Sub-Module Model Serial Hw Status
— ————————— —————— ———— ——- ——-
1 Inline Power Module WS-F6K-PWR 1.0 Ok
5 Policy Feature Card 3 WS-F6K-PFC3A SAD0906076P 2.4 Ok
5 MSFC3 Daughterboard WS-SUP720 SAD0905052Z 2.4 Ok
6 Policy Feature Card 3 WS-F6K-PFC3A SAD08490B95 2.4 Ok
6 MSFC3 Daughterboard WS-SUP720 SAD0850062A 2.4 Ok
7 Centralized Forwarding Card WS-F6700-CFC SAL090607GH 2.0 PwrDeny

Mod Online Diag Status
— ——————-
1 Pass
2 Pass
3 Pass
5 Pass
6 Pass
7 Unknown
9 Unknown

If you have checked that the power supplies deliver enough power to turn on all of the modules, then enter the power enable module [module slot number] command in order to enable the power for the module that appears as PwrDeny:

Switch(config)#power enable module 4

hpssacli

Show configuration:
/opt/hp/hpssacli/bin/hpssacli ctrl all show config

Controller status
/opt/hp/hpssacli/bin/hpssacli ctrl all show status

Show detailed controller information for all controllers
/opt/hp/hpssacli/bin/hpssacli ctrl all show detail

Show detailed controller information for controller in slot 0
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 show detail

Rescan for New Devices
/opt/hp/hpssacli/bin/hpssacli rescan

Physical disk status
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 pd all show status

Show detailed physical disk information
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 pd all show detail

Logical disk status
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld all show status

View Detailed Logical Drive Status
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld 2 show

Create New RAID 0 Logical Drive
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 create type=ld drives=1I:1:2 raid=0

Create New RAID 1 Logical Drive
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 create type=ld drives=1I:1:1,1I:1:2 raid=1

Create New RAID 5 Logical Drive
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 create type=ld drives=1I:1:1,1I:1:2,2I:1:6,2I:1:7,2I:1:8 raid=5

Delete Logical Drive
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld 2 delete

Add New Physical Drive to Logical Volume
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld 2 add drives=2I:1:6,2I:1:7

Add Spare Disks
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 array all add spares=2I:1:6,2I:1:7

Enable Drive Write Cache
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 modify dwc=enable

Disable Drive Write Cache
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 modify dwc=disable

Erase Physical Drive
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 pd 2I:1:6 modify erase

Turn on Blink Physical Disk LED
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld 2 modify led=on

Turn off Blink Physical Disk LED
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 ld 2 modify led=off

Modify smart array cache read and write ratio (cacheratio=readratio/writeratio)
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 modify cacheratio=100/0

Enable smart array write cache when no battery is present (No-Battery Write Cache option)
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 modify nbwc=enable

Disable smart array cache for certain Logical Volume
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 logicaldrive 1 modify arrayaccelerator=disable

Enable smart array cache for certain Logical Volume
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 logicaldrive 1 modify arrayaccelerator=enable

Enable SSD Smart Path
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 array a modify ssdsmartpath=enable

Disable SSD Smart Path
/opt/hp/hpssacli/bin/hpssacli ctrl slot=0 array a modify ssdsmartpath=disable

 

Running ADU report without hpacucli

cd /opt/hp/hpssaducli/bin
[test]:/opt/hp/hpssaducli/bin # ls
hpssaducli hpssaduesxi upgrade.txt
[test]:/opt/hp/hpssaducli/bin # ./hpssaducli -f /tmp/adu-report.zip
HP Smart Storage Diagnostics 1.60.17.0

Posted in HP

Brocade DATA Collections

There are 2 types of Data Collection associated with Brocade switches, “supportshow” and “supportsave”.

If the problem is related to basic “port issues”, a “supportshow” is sufficient. However, a more complex problem that involves Zoning, Performance, Reboots, CP Failovers, Fabric wide problems etc, requires a “SupportSave” type of collection. If the problem is multiswitch related (ISL connections, long distance configurations etc.) we need the supportsave from all relevant switches in the fabric.

The amount and type of information displayed in a supportshow output is depending on the type of switch as well as the collection options enabled in the switch configuration. This can be configured with the “supportshowcfgenable [option]” and “supportshowcfgdisable [option]”.

The output from the “supportshowcfgshow” command shows which subscripts will be enabled. The default groups are always enabled. Only on special occasions you will be asked to enable additional groups if necessary.

 

Performance and Intermittent Error Related Issues

If there is no sign of any obvious physical issue there might be link related problems which can identify performance problems and/or protocol related errors. Brocade counters are cumulative and keep doing so until a certain counter wraps, a switch reboots or the statistics are manually cleared.

Storage vendors for example require in these circumstances that a new baseline is created, a certain run-time has been achieved and separate commands are submitted against the suspected switch or switches.

To create a new baseline with cleared counters do the following:

  1. Log in to the switch via Telnet or SSH
  2. Submit the “statsclear” command
  3. Submit the “slotstatsclear” command

After the agreed (mostly around one hour) run-time capture a new supportsave and upload this to the vendor’s service request.

SupportSave Data Collection (CLI Method)

When the problem is more sophisticated a supportsave from the switch is required. The supportsave command is available as of Fabric OS version 4.4 however, Fabric OS versions (> 6.2.x) provide a significant better collection of logs which represent the status overview of the switch and fabric. If you have a director class switch with two CP’s and/or core plus function blades it will also collect information from all the blades.

The supportsave will upload between 25 and 80 files depending on platform, Fabric OS level and enabled features to an FTP or SCP server. These will not be tarred or zipped into one file so it is important you create such an archive with a meaningful name. (ie. switchname-domainid-fabricid.zip)

Example

switch:admin> supportsave -u anonymous -p password -h xxx.xxx.xxx.xxx -d /directory -l ftp

This command collects RASLOG, TRACE, supportShow, core file, FFDC data and then transfer them to a FTP/SCP server or a USB device. You could also simply type the “supportsave” command without any parameters and you will be asked for the extra information before the command is actually executed. The operation will usually take several minutes to complete.
NOTE: supportSave will transfer existing trace dump file first, then automatically generate and transfer latest one. There will be two trace dump files transferred after this command.

OK to proceed? (yes, y, no, n): [no] y
Saving support information for switch:BR4100_IP127, module:RAS…
Saving support information for switch:BR4100_IP127, module:CTRACE_OLD…
Saving support information for switch:BR4100_IP127, module:CTRACE_NEW…
etc……

To upload the files you can specify the FTP parameters inline (as modeled above) or through the supportftp command (see Fabric OS V5.1 command Reference guide) .

  1. Host IP: XXX.XXX.X.X (example 192.168.1.1)
  2. User Name: admin
  3. Password:
  4. Remote Directory: tmp (example: tmp)
  5. Saving support information

SupportShow Data Collection

This is a non disruptive procedure and can be performed by the CE or the customer.

You can use your favorite terminal emulation utility. Refer to the respective documentation how to turn on capturing output to a file.

Telnet or SSH

  1. Telnet or SSH into Brocade switch
  2. Enter username and password
  3. Start logging to file on the Telnet session.
    NOTE: For Windows standard telnet, this is under the terminal pulldown menu.
  4. Enter command: supportShow
  5. Upload the telnet log to TUF.
Posted in EMC

Troubleshooting EMC DataDomain Disk problems

Product: ES30 Enclosure

autosupport

or use the following commands:

Log in as a sysadmin user

# alerts show current

# disk show state

 

After replacement run

# disk rescan

# disk show state

 

 

Posted in EMC

Data collection DS Storage Systems

GUI (depends on firmware version)

a) Advanced -> Troubleshooting -> Support Data -> Collect…
b) Support tab -> Gather Support Information -> Save Support Information
c) Support tab -> Gather Support Information
d) Monitor -> Health -> Collect Support Data…
e) Monitor -> Health -> Collect Support Data Manually…

CLI

SMcli ctrl_a ctrl_b -c ‘save storageSubsystem supportData file=”/<path>/supportdata”;’

Posted in IBM