we have some FS7300 and after the upgrade to stor2rrd version 8 one of them is not updating the performance statistics.

in the logs there is just :

 ERROR  - svcperf.pl: Full list of IOSTATS times is empty

I've checked the storage ,from my understanding the stats are under /dumps/iostats and I can see them

the connection test is also ok not showing any error

I had this on 7.30 version, now on 7.95

Do you have any idea how to enable Alias New button for Nodes in IBM Spectrum Scale storage window?

i have problem with monitoring IBM fs5030. After migration xorux from centos to RHEL 9 i get error in log connection closed.

How i can fix it ? Migration xorux to RHEL 7.9 ?

STOR2RRD version 7.30

I migrated the stor2rrd application from older RHEL 7.9 to 9.3.

All arrays such Dell/Hitachi/HPE woks properly.

I have a problem with connection to SVC/V7000, i've getting "connection closed" in error log and it's all :(

ERROR LOG:

"

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

"

Do you have any idea how i can debug what closing this connection?

stor2rrd version: 7.30

linux version: release 9.3 (Plow)

+++++++++++++++

ssh authorization: nok

script /home/stor2rrd/stor2rrd/bin/ssh_test_svc.pl timed out after : 30 seconds

+++++++++++++++

I have created a specific STOR2RRD user for the application with MONITOR rights and I have two other 5200 units and two 5000 units running with same settings without any issue. I have tested to remove the faulty 5200 unit and run the ./load.sh script between every trying.

Found the forum thread https://forum.xorux.com/discussion/979/ssh-authorization-nok-testing-vplex and I have tested ./bin/config_check.sh script and I got below response.

+++++++++++++++

+++++++++++++++

Any ideas what I am missing?

one of them appear in the UI, but the other did not appear although i can list it under HMC total.

the load_hmc_rest_api.sh did not give any error.

HMC version 9

I've added stor2rrd v7.70 to our existing lpar2rrd server. I have configured it to connect to our first FS9100 that is running 8.3.1.8 code.

On the FS9100 I created the stor2rrd user (local) and gave it the monitor role. I verified that I can log in with this user.

When I run the connection test in stor2rrd I get these errors:

SSH network connection: TCP connection to x.x.x.x:22 is OK.

Crontab test: OK

SSH authorization: NOK

Tue Aug 29 11:17:19 2023 - ERROR   - ssh_test.pl:   current account does not have Administration or RestrictedAdmin access!!
Tue Aug 29 11:17:19 2023 - ERROR   - ssh_test.pl: stor2rrd user on all IBM SVC/Storwize must belong to "RestrictedAdmin" or "Administrator" UserRole
$VAR1 = [
          'name stor2rrd',
          'role Monitor',
          'owner_id ',
          'owner_name '
        ];

If I understand your documentation correctly, I should be able to use the monitor role when our FS is on 8.3.1.2 or newer.

About stor2rrd info:

STOR2RRD version 7.70

STOR2RRD edition free

OS info Linux

Perl version v5.26.1

Web server info Apache

RRDTOOL version 1.7.0

SQLite version n/a

Any idea why it is behaving like this?

I have tried setting up an LDAP backed user and was able to login to the DS8000 Management Console with the credentials, but when I try to connect with the dscli from the STOR2RRD server, I get that "CMUN00018E Unable to connect to the management console server" message. Is there something I need to do or have configured on the DS8000 to allow dscli to login with the user and password I created?

I hope you can help, for some reason Stor2rrd stopped collecting data from our FS9100 last Wednesday @ 14:55. I've checked the logs for the host that runs Stor2rrd and nobody was on it at this time and no changes occurred on the storage unit at this time either.

What I see in the logs is the following lines repeated continuously

Tue Jun 20 12:40:58 2023: Capacity for pool "dmt_scm_fs9100a" not found! /home/stor2rrd/stor2rrd/bin/AlertStor2rrd.pm:2185

Tue Jun 20 12:40:58 2023: Capacity for pool "ixn_scm_fs9100a" not found! /home/stor2rrd/stor2rrd/bin/AlertStor2rrd.pm:2185

Tue Jun 20 12:40:58 2023: Capacity for pool "dmt_csnx_fs9100a" not found! /home/stor2rrd/stor2rrd/bin/AlertStor2rrd.pm:2185

Tue Jun 20 12:40:58 2023: Capacity for pool "ixn_csnx_fs9100a" not found! /home/stor2rrd/stor2rrd/bin/AlertStor2rrd.pm:2185

Max. recursion depth with nested structures exceeded at /usr/opt/perl5/lib/5.28.1/aix-thread-multi/Storable.pm line 278, at /home/stor2rrd/stor2rrd/bin/svcperf.pl line 945.

I did see you have mentioned in https://forum.xorux.com/discussion/1264/svc-some-data-missing about Max recursion on AIX due to the perl version, so I have included the lines

"use Storable qw(retrieve nstore);

# Bug: Max. recursion depth with nested structures exceeded

Storable::recursion_limit=-1;

Storable::recursion_limit_hash=-1;"

I've also check for ownership issues and found some owned by apache but this has not made a difference.

Any suggestions would be a great help.

I have a Quantum i6k Tape Library with IBM Drives. I've enable library managed cleaning for my edlm drive. The tape for such needs to be imported from I/E station as per manual. Can this be done by manually placing the cartridge in magazine and using LMC to import it without using the I/E station.

When I run the config check I get (IP addr. hidden):

TCP connection to "1.2.3.4" on port "22" is ok

. /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg; /bin/perl /home/stor2rrd/stor2rrd/bin/ssh_test_svc.pl 1.2.3.4 svc_STG_Rstadmscript /home/stor2rrd/.ssh/swrau 30 sshtest XXXXX 0

Access restricted to authorized D&H Distributing usersPermission denied (keyboard-interactive).

Error: Unable to connect to remote machine. unable to establish master SSH connection: master process exited unexpectedly

Tue Mar 28 16:53:52 2023 - ERROR  - ssh_test.pl: Unable to connect to remote machine 1.2.3.4 - Return code: 1

But the ssh connection is working fine:

stor2rrd]$ ssh -i ~/.ssh/swrau svc_STG_Rstadmscript@1.2.3.4 "lscurrentuser"

Access restricted to authorized D&H Distributing usersname svc_STG_Rstadmscript

role RestrictedAdmin

owner_id

owner_name

password_expiry_time

multi_factor no

password_sshkey_required no

gui_disabled no

cli_disabled no

rest_disabled no

And if I change that exact same account on the storage to a Local user, instead of a Remote user, with no other changes, and with the exact same SSH keypair, it works fine - without changing a thing in Stor2RRD:

stor2rrd]$ ./bin/config_check.sh DRVDI_FS5200

=========================

STORAGE: DRVDI_FS5200: SWIZ : sample rate: 300 seconds

=========================

 TCP connection to "1.2.3.4" on port "22" is ok

. /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg; /bin/perl /home/stor2rrd/stor2rrd/bin/ssh_test_svc.pl 1.2.3.4 svc_STG_Rstadmscript /home/stor2rrd/.ssh/swrau 30 sshtest XXXXX 0

Access restricted to authorized D&H Distributing usersMachine Name:      DR01IF52PD001

Machine Type-Model:   4662-6H2

etc...

And ssh connection test looks no different:

stor2rrd]$ ssh -i ~/.ssh/swrau svc_STG_Rstadmscript@1.2.3.4 "lscurrentuser"

Access restricted to authorized D&H Distributing usersname svc_STG_Rstadmscript

role RestrictedAdmin

owner_id

owner_name

password_expiry_time

multi_factor no

password_sshkey_required no

gui_disabled no

cli_disabled no

rest_disabled no

The point is that coming fw version 8.6 brings some changes in the API (xml file) and stor2rrd might stop working. It could be already tested in advance on 8.5.1+

Max. recursion depth with nested structures exceeded at /usr/lib64/perl5/vendor_perl/Storable.pm line 278, at /opt/stor2rrd/bin/svcperf.pl line 902.

Could you help me with debugging it?

P.S. Another SVC works as expected.

Regards, Grzegorz

[lpar2rrd@LIN-SDSMON01-VH bin]$ ./config_check.sh

=========================

STORAGE: FS9100A: SWIZ : sample rate: 300 seconds

=========================

 TCP connection to "fs9100a" on port "22" is ok

. /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg; /usr/bin/perl /home/stor2rrd/stor2rrd/bin/ssh_test_svc.pl fs9100a lpar2rrd /home/lpar2rrd/.ssh/id_rsa 30 sshtest XXXXX 0

"_state" is not defined in %Net::OpenSSH::Constants::EXPORT_TAGS at /home/lpar2rrd/stor2rrd/lib/Xorux/Net/OpenSSH.pm line 20.

Can't continue after import errors at /home/lpar2rrd/stor2rrd/lib/Xorux/Net/OpenSSH.pm line 20.

BEGIN failed--compilation aborted at /home/lpar2rrd/stor2rrd/lib/Xorux/Net/OpenSSH.pm line 20.

Compilation failed in require at /home/stor2rrd/stor2rrd/bin/ssh_test_svc.pl line 26.

 This must work without providing password:

 ssh -o ConnectTimeout=80 -o StrictHostKeyChecking=no -o SendEnv=no -i /home/lpar2rrd/.ssh/id_rsa lpar2rrd@fs9100a "lscurrentuser"

 connection failed!!

BUT Connection is working fine :

[lpar2rrd@LIN-SDSMON01-VH ~]$ ssh -o ConnectTimeout=80 -o StrictHostKeyChecking=no -o SendEnv=no -i /home/lpar2rrd/.ssh/id_rsa lpar2rrd@fs9100a "lscurrentuser"

IT IS AN OFFENSE TO CONTINUE WITHOUT PROPER AUTHORIZATION.

This system is for the use of authorized users only. Individuals using this computer system without authority, or in excess of their authority, are subject to having all of their activities on this system monitored and recorded by system personnel. In the course of monitoring individuals improperly using this system, or in the course of system maintenance, the activities of authorized users may also be monitored. Anyone using this system expressly consents to such monitoring and is advised that if such monitoring reveals possible evidence of criminal activity, system personnel may provide the evidence of such monitoring to law enforcement officials.

name lpar2rrd

role Monitor

owner_id

owner_name

[lpar2rrd@LIN-SDSMON01-VH ~]$

Can anybody help ??

Thanks,

Michel

I've noticed recently that our stor2rrd server is drawing additional ports which don't exists in configuration for our FS 5200.

It has 2 nodes, each node one FC card and only 2 ports are used and cabled to the SAN. Below output from cli:

id fc_io_port_id port_id type port_speed node_id node_name WWPN           nportid status attachment cluster_use adapter_location adapter_port_id

0 1           1     fc 32Gb     1     node1   500507681211155D 652200 active switch   local_partner 1              1

1 2           2     fc 32Gb     1     node1   500507681212155D 662200 active switch   local_partner 1              2

24 1           1     fc 32Gb     3     node2   500507681211155E 652600 active switch   local_partner 1              1

25 2           2     fc 32Gb     3     node2   500507681212155E 662600 active switch   local_partner 1              2

In stor2rrd server in "data" folder, file port.cfg is correct:

$ cat PORT/port.cfg

node1_p01:(FC 500507681211155D)

node1_p02:(FC 500507681212155D)

node2_p01:(FC 500507681211155E)

node2_p02:(FC 500507681212155E)

But file ports.col is showing additional ports from p03 to p07 for each node,

and what's the worse it sees some traffic on _p03 for both and drawing it in GUI.

$ cat PORT/ports.col

0 : node1_p01 (FC 500507681211155D)

1 : node1_p02 (FC 500507681212155D)

2 : node1_p03

3 : node1_p04

4 : node1_p05

5 : node1_p06

6 : node1_p07

7 : node2_p01 (FC 500507681211155E)

8 : node2_p02 (FC 500507681212155E)

9 : node2_p03

10 : node2_p04

11 : node2_p05

12 : node2_p06

13 : node2_p07

I have already tried to delete this 5200 from stor2rrd configuration, delete all required folders and files,

then add it again to stor2rrd and rerun load.sh again. But it behaves the same , it still sees ports p03 to p07

and some traffic on p03.

We are running firmware Version: 8.5.0.6 , and model is 4662-6H2 .

please have your developers check the formula that calculates the SFP Power in db from the Watt number in stor2rrd. There is a mistake.

For Example , if the power is 466uW , you are using the formula:

10*ln(466/1000) = -7.64dBm.

when it should be:

10*log(466/1000) = -3.3dBm.

which means you are using "ln" instead of "log" . On the Brocade Switches, stor2rrd is using the correct logarithm, but IBM SVC/Storwize/FlashSystem seems to use "ln" instead of "log". The result is that the number is 2.3 times larger.

thanks a lot and happy new year.

PS: This is what I found on the internet on how it should be:

https://www.dell.com/support/kbdoc/de-de/000028053/how-to-interpret-sfp-transceiver-tx-and-rx-power-levels-as-part-of-troubleshooting-the-sfp-transceiver

Quote:

Units of measurement

As seen in the brocade sfpshow output, the light level is represented in dBm and uW.

Decibels (dB) is the ratio of output power to input power, expressed as 10*log (power ratio).

dBm = power in decibels relative to 1mW (1000uW). A reading of 0 dBm is 1mW. 

If the power reading is plus (+) dBm the power is >1mW, minus (-) is <1mW.

For example, in the Brocade sfpshow output above, 466uW is 10*log(466/1000) = -3.3dBm.

Also displayed is the light power in uW.

uW = micro Watts which is the actual measure of the light power (not a ratio)

I have a question regarding the permission changes for the data.db file. During the update from 7.41 to 7.51 I noticed the following error:

chmod -R o + r, o + x / home / lpar2rrd / lpar2rrd / data
chmod: changing permissions of '/home/lpar2rrd/lpar2rrd/data/_DB/data.db': Operation not permitted

Despite this, the upgrade is over and I wonder if this is the intended action or the error should not be displayed. The data.db file belongs to the user apache:

[lpar2rrd @ LPAR2RRD lpar2rrd] $ ls -la data / _DB / data.db
-rw-rw-rw- 1 apache apache 118784 Oct 6 11:40 date / _DB / data.db

I did the upgrade from the lpar2rrd user who does not have root privileges. Should I manually add permissions to data.db or it doesn't matter and won't matter in the next upgrades?

Below I present the entire listing of the upgrade:

Where is LPAR2RRD actually located [/home/lpar2rrd/lpar2rrd]:
Extracting distribution
Backing up original version : 7.41 to /home/lpar2rrd/lpar2rrd/BACKUP-INSTALL/lpar2rrd-7.41
Saving 7.41 configuration
Copy new version to the target destination
Configuring new /home/lpar2rrd/lpar2rrd/etc/lpar2rrd.cfg
Setting file/dir permissions, it might take some time in big environments
chmod -R o+r,o+x /home/lpar2rrd/lpar2rrd/data
chmod: changing permissions of '/home/lpar2rrd/lpar2rrd/data/_DB/data.db': Operation not permitted

Stopping LPAR2RRD daemon

Removing wrong RHV storage IOPS data

Upgrade to version 7.51 is done
Now you can start the tool:

 cd /home/lpar2rrd/lpar2rrd
 ./load.sh 2>&1 | tee logs/load.out-initial

Wait for finishing of that, then refresh the GUI (Ctrl-F5)

[lpar2rrd@hmmcrrd stor2rrd]$ ssh lpar2rrd@192.168.0.7 lsmdisk

id name   status mode  mdisk_grp_id mdisk_grp_name capacity ctrl_LUN_# controller_name UID tier          encrypt site_id site_name distributed dedupe over_provisioned supports_unmap

0  mdisk0 online array 0            POOL1-NLSAS    275.5TB                                 tier_nearline no                        yes         no     no               no

[lpar2rrd@hmmcrrd stor2rrd]$ cd /home/stor2rrd/stor2rrd

[lpar2rrd@hmmcrrd stor2rrd]$

[lpar2rrd@hmmcrrd stor2rrd]$ ./bin/config_check.sh

=========================

STORAGE: HOSTNAME: SWIZ : sample rate: 300 seconds

=========================

  TCP connection to "192.168.0.7" on port "22" is ok

. /home/stor2rrd/stor2rrd/etc/stor2rrd.cfg; /usr/bin/perl /home/stor2rrd/stor2rrd/bin/ssh_test_svc.pl 192.168.0.7 lpar2rrd "" 30 "sshtest" XXXXXX 1

Error: Unable to connect to remote machine. unable to establish master SSH connection: password authentication failed

Fri Mar  4 16:32:22 2022 - ERROR   - ssh_test.pl: Unable to connect to remote machine 192.168.0.7 - Return code: 1

  connection failed!!

Could You please help me?

perl /home/stor2rrd/stor2rrd/bin/conntest.pl 192.168.1.100 1750
Connection to "192.168.1.100" on port "1750" is ok

But if I try connect to the storage I got this error:

[lpar2rrd@tix-stor2rrd-p1 ~]$ /opt/ibm/dscli/dscli  -hmc1 192.168.1.100 -user lpar2rrd  
CMUN00018E  Unable to connect to the management console server

Date/Time: June 5, 2020 8:30:36 PM CEST IBM DSCLI Version: 7.7.21.39 DS: -

I also configured the storage device on the browser interface and if I test the connection the error is:
Under user: lpar2rrd
DSCLI command failed: "/opt/ibm/dscli/dscli -hmc1 192.168.1.106 -user lpar2rrd whoami"
Date/Time: June 5, 2020 8:34:08 PM CEST IBM DSCLI Version: 7.7.21.39 DS: -
CMUN00018E whoami: : Unable to connect to the management console server

lpar2rrd user on all IBM DS8K must belong to "monitor" role at least

But the user lpar2rrd is correctly assigned to the role 'Monitor'. Infact I can login whith this user to the storage gui

Is the dscli supported in the virtual appliance?
Any suggestion?

Regards
Giuseppe