HPE3PAR Error in gathering statvlun

kutz
kutz
in HPE
Hello,
I'm facing the following on my HPE3PAR 20400 error.log:
<snip>
Mon Feb  4 12:36:03 2019 ERROR   : hp3parperf.pl: Parent died in SIG ALRM - return code: 102
Mon Feb  4 12:36:09 2019 ERROR   : hp3parperf.pl:       Child server statvlun died in SIG ALRM - return code: 104
<snip>

Months ago I head the same which I fixed by using:
<snip>
hpe3parperf.pl:
                #$command = $ssh." statvlun -rw -d ".$interval." -iter 1";
                $command = $ssh." statvlun -ni -rw -d ".$interval." -iter 1";
<snip>

I'm using quite old Version of stor2rrd 2.01 - might this be the reason for the behaviour?

Cheers,
ku

Comments

  • Pavel
    Pavel
    Hi,

    do you have many of vluns? How many roughly?
    we do not use -ni, we had

    definitelly upgrade to the latest one 2.41.
    I cannot say if that resolves it, if not then send us logs.
    The latest version is only the version which we support for free users.

    cd /home/stor2rrd/stor2rrd  # or where is your STOR2RRD working dir
    export STORAGE_NAME=<your storage name alias>

    tar cvhf logs.tar tmp/$STORAGE_NAME *txt logs/*$STORAGE_NAME
    gzip -9 logs.tar

    Send us logs.tar.gz via https://upload.stor2rrd.com

  • kutz
    kutz
    Hello Pavel,
    we are having around 26000 vluns in use.
    After changing the Perl Script as mentioned in my previous Thread, we exclude the vluns which do not have Perfdata sampled by using "-ni" switch. After doing this everything went fine.

    Will follow your suggestion in upgrading - thus I do not think that this will help. I'm thinking of timeout values which need to be applied accordingly.
    We are sampling every 5 minutes HPE3PAR Data. We have 3 HPE3PARs in use. Only Problems on the biggest one.

    If executing commands manually (via ssh commandline) results are given properly.
    Sometimes we receive "unable to alloc 4800 bytes" on executing.

    Cheers,
    ku

  • Pavel
    Pavel
    how long takes that command directly from ssh?

    time ssh ... "statvlun ..."

    There is alert set to 10 minutes if 300 is in SAMPLE_RATE (etc/stor2rrd.cfg) which obviously timing out.

  • kutz
    kutz
    Hello Pavel,
    did the upgrade to 2.41 - problem persists.
    Uploaded Data via upload.stor2rrd.com.
    SAMPLE_RATE=300

    Output of time command during execution of "statvlun -ni -rw -d 1 -iter 1"
    <snip>
    real    0m22.711s
    user    0m0.176s
    sys     0m0.062s
    <snip>

    Cheers,
    ku
  • kutz
    kutz
    Hello Pavel,
    since upgrade to 2.41 it seems to work.
    Thanks for you quick support into this.

    Cheers,
    ku
  • kutz
    kutz
    Sorry to bother - it works only sporadically.
    Still facing in error.log-HPE3PAR20400:
    <snip>
    Tue Feb  5 08:56:09 2019 ERROR   : hp3parperf.pl:       Child server statvlun died in SIG ALRM - return code: 104
    Tue Feb  5 08:56:09 2019 ERROR   : hp3parperf.pl: Child (27066384) exited with code 26624 (6800) = 104
    <snip>

    Even if changing the execution command of statvlun to
    statvlun -ni -rw -d 1 -iter 1

    Any Ideas?

    Cheers,
    ku
  • Pavel
    Pavel
    time ssh <3par> "statvlun -ni -rw -d 300 -iter 1 "
  • kutz
    kutz
    See below:
    real    5m22.021s
    user    0m0.248s
    sys     0m0.068s


  • Pavel
    Pavel
    edit bin/hp3parperf.pl

    add 3 lines behind line 664:
    print "DEBUG: statvlun  $timeout\n";
    $timeout = 600;

    It will look like this:
    sub server_statvlun {
      if ( not defined $timeout or $timeout eq '' ) {
        $timeout = 360;
      }
      else {
        $timeout = $timeout + 60;
      }

    print "DEBUG: statvlun  $timeout\n";
    $timeout = 600;

    let it work and let us know if that helps, attach also this:
    tail logs/output.log-HPE3PAR20400







  • kutz
    kutz
    Did the change in bin/hp3parperf.pl:
    <snip>
      +497  sub server_statvlun {
      +498    if ( not defined $timeout or $timeout eq '' ) {
      +499      $timeout = 360;
      +500    }
      +501    else {
      +502      $timeout = $timeout + 60;
      +503    }
      +504
      +505  print "DEBUG: statvlun  $timeout\n";
      +506  $timeout = 600;
    <snip>
    In my bin/hp3parperf.pl the statement you mentioned started at line 497.

    Cheers,
    ku



  • kutz
    kutz
    I received in error.log-HPE3PAR20400
    <snip>
    Global symbol "$command" requires explicit package name at /opt/stor2rrd/bin/hp3parperf.pl line 605.
    Execution of /opt/stor2rrd/bin/hp3parperf.pl aborted due to compilation errors.
    <snip>


  • Pavel
    Pavel
    use this :

    Gunzip it and copy to /home/stor2rrd/stor2rrd/bin
    If your web browser gunzips it automatically then just rename it: mv hp3parperf.pl.gz hp3parperf.pl

    Size mus be
    ls -l bin/hp3parperf.pl
    -rwxrwxr-x+ 1 stor2rrd stor2rrd 20974 Feb  6 15:43 bin/hp3parperf.pl








  • kutz
    kutz
    I'll reverted the change to below:
    <snip>
    sub server_statvlun {
      if ( not defined $timeout or $timeout eq '' ) {
        $timeout = 360;
        $timeout = 600;
      }
      else {
        $timeout = $timeout + 60;
        $timeout = 600;
      }
    <snip>

    Error Log tells nothing now.

  • Pavel
    Pavel
    I really wanted to have there debug print to see how timeout was set before, can you put  there file as per my previous email?

    tail logs/output.log-HPE3PAR20400
  • kutz
    kutz
    Using your script ends up in
    <snip>
    Global symbol "$command" requires explicit package name at /opt/stor2rrd/bin/hp3parperf.pl line 605.
    Execution of /opt/stor2rrd/bin/hp3parperf.pl aborted due to compilation errors.
    Global symbol "$command" requires explicit package name at /opt/stor2rrd/bin/hp3parperf.pl line 605.
    Execution of /opt/stor2rrd/bin/hp3parperf.pl aborted due to compilation errors.
    Global symbol "$command" requires explicit package name at /opt/stor2rrd/bin/hp3parperf.pl line 607.
    Execution of /opt/stor2rrd/bin/hp3parperf.pl aborted due to compilation errors.
    Global symbol "$command" requires explicit package name at /opt/stor2rrd/bin/hp3parperf.pl line 607.
    Execution of /opt/stor2rrd/bin/hp3parperf.pl aborted due to compilation errors.
    Global symbol "$command" requires explicit package name at /opt/stor2rrd/bin/hp3parperf.pl line 607.
    Execution of /opt/stor2rrd/bin/hp3parperf.pl aborted due to compilation errors.
    <snip>

    I'm going back to my script - which works.

    Cheers,
    ku

  • Pavel
    Pavel
    you must use something else than is on the link I provided you, it does not fail anyhow, more over there is no $command variable on the line with error: 
        open( my $tmpfile, '>', $filename ) || error( "open file failed: $filename :  $!", 111 ) && exit 111;

    Script on the link has this size:
    ls -l bin/hp3parperf.pl
    -rwxr-xr-x 1 stor2rrd stor2rrd 20974 Feb  7 09:36 bin/hp3parperf.pl

    pls use it and let us known.


  • kutz
    kutz
    By the way - fixing timeout from 300 to 600 solves the problem. Statistics are now collected correctly.
    Thanks for your support.
  • Pavel
    Pavel
    I know, but what I want to see is how $timeout was set before. it should have been set 360 but it would work even befor when that cmd takes 320secs at you as per above testing.

    thanks.

Sign In or Register to comment.

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Register

Categories

In this Discussion