Unity 400f error

Veguardian

Hi, 
I`ve successfully added vnx storage using the Virtual Appliance, looks very good. 
When I try adding EMC Unity 400f storage I get errors when runnning ./load.sh; 

An error occured, check /home/lpar2rrd/stor2rrd/logs/error.log and output of load.sh

$ tail -8 /home/lpar2rrd/stor2rrd/logs/error.log

Fri Nov 18 13:54:32 2016: Unity400F: Problem with configuration load, no VOLUME has been found, is there really exist one? : /home/stor2rrd/stor2rrd/data/Unity400F/config.html bin/LoadDataModule.pm:11704

Fri Nov 18 13:54:32 2016: Unity400F: Volumes cfg file has been found : /home/stor2rrd/stor2rrd/data/Unity400F/VOLUME/volumes.cfg ./bin/storage.pl95

Fri Nov 18 13:54:32 2016: Exiting Unity400F as some core cfg file is missing: config.html || pool.cfg || volumes.cfg

                 === Check http://www.stor2rrd.com/install-storage.htm for more ===

Fri Nov 18 13:54:35 CET 2016

From the errorlogs I can see a lot of this: 

Fri Nov 18 13:55:09 2016: uemcli command failed: "/usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXXXX -noHeader /metrics/value/hist -path "sp.*.net.device.*.bytesInRate, sp.*.net.device.*.bytesOutRate, sp.*.net.device.*.pktsInRate, sp.*.net.device.*.pktsOutRate" show -count 1 -interval 300 -output nvp" : /home/stor2rrd/stor2rrd/bin/unityperf.pl:1061 :

Fri Nov 18 13:55:09 2016: Operation failed. Error code: 0x1000303 :

Fri Nov 18 13:55:09 2016: Internal error on server side. Please contact server support (Error Code:0x1000303) :

Please advice. 

Veguardian

Connection check is ok; 

=========================

STORAGE: Unity400F: UNITY

=========================

/usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXX -noHeader /sys/general show -detail

1:    System name             = Unity400F

      Model                   = Unity 400F

      Platform type           = EMC Storage System

      Product serial number   = CKM00xxxxxxxxx

      Auto failback           = on

      Health state            = OK (5)

      Health details          = "The system is operating normally."

      Power (Present)         = 458 watts

      Power (Rolling Average) = 470 watts

  connection ok

Pavel

Hi,

is this command really failing?
/usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXXXX -noHeader /metrics/value/hist -path "sp.*.net.device.*.bytesInRate, sp.*.net.device.*.bytesOutRate, sp.*.net.device.*.pktsInRate, sp.*.net.device.*.pktsOutRate" show -count 1 -interval 30 -output nvp"

Try to execute it from cmd line uunder stor2rrd account.
Sounds like Unity issue when it says "Operation failed. Error code: 0x1000303"
If that is like that, can you contact EMC support?

Veguardian

Thanks for your reply Pavel, 

I`ve been doing some tests from command line now and it seems to be error with just some of the metrics. 

Some that work: 

[root@M01-STOR2RRD ~]# /usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXX -noHeader /metrics/value/hist -path sp.*.fibreChannel.fePort.*.writesRate show -count 1 -interval 60 -output nvp

1:      Timestamp         = 2016-11-19 15:40:00

        SP                = spa

        FC front-end port = spa_fc4

        Write Counts/s    = 24.92

2:      Timestamp         = 2016-11-19 15:40:00

        SP                = spa

        FC front-end port = spa_fc5

        Write Counts/s    = 24.67

3:      Timestamp         = 2016-11-19 15:40:00

        SP                = spb

        FC front-end port = spb_fc4

        Write Counts/s    = 1129

4:      Timestamp         = 2016-11-19 15:40:00

        SP                = spb

        FC front-end port = spb_fc5

        Write Counts/s    = 1127

[root@M01-STOR2RRD ~]# /usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXX -noHeader /metrics/value/hist -path sp.*.cpu.summary.utilization show -count 1 -interval 60 -output nvp

1:      Timestamp          = 2016-11-19 15:41:00

        SP                 = spa

        summary CPU Util % = 10.31

2:      Timestamp          = 2016-11-19 15:41:00

        SP                 = spb

        summary CPU Util % = 14.87

and some does not work. 

[root@M01-STOR2RRD ~]# /usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXX /metrics/value/hist -path sp.*.net.device.*.pktsOutRate show -count 1 -interval 60 -output nvp

Storage system address: x.x.x.x

Storage system port: 443

HTTPS connection

Operation failed. Error code: 0x1000303

Internal error on server side. Please contact server support (Error Code:0x1000303)

Also, if interval is set to 30 it will fail: 

[root@M01-STOR2RRD ~]# /usr/bin/uemcli -d x.x.x.x -u stor2rrd -p XXX -noHeader /metrics/value/hist -path sp.*.cpu.summary.utilization show -count 1 -interval 30 -output nvp

Operation failed. Error code: 0x1000017

Command line parsing failed near "30" token.

There is a syntax error in the command. Please recheck the command syntax. (Error Code:0x1000017)

I will log a case with EMC on Monday. 

Pavel

ok, it might be even caused by different firmware.
Let us know what EMC finds, thanks!

Veguardian

I have been in contact with EMC now, and they confirmed there was a bug causing this issue. 
This was the solution, which the EMC engineer ran; 

Workaround:

   1. Run "bc_recovery.pl -r"
   2. Select "y" when asking for metrics db verify.
      E.g.
      Run metrics   database verify:  [y/n/q]:y

Now everything is working as expected :-)  

Thanks for your effort on this awesome product! Now voting for Vplex and Isilon support as well ;-)

Pavel

Hi,

thanks for sharing solution.
We should have access to VMAX/VPLEX soon, then we will start implementation immediatly.