Problem with LPAR configured with passiv WLM

joerg
joerg
in LPAR2RRD
Hello,
after upgrade to lpar2rrd 6.02 and lpar2rrd-agent 6.01i run into problems.

Two AIX LPARs are configured with passive WLM. This LPARs had after upgrade only send ones  data to the lpar2rr server.
Then they fill up the /var filesystem.

Is there any known issue with lpar2rrd and WLM in V6.02?

I had comment out the crontab jobs at agent side. Here is what happens when i start the agent with -d flag.

v2db02.lpar2rrd #  /usr/bin/perl /opt/lpar2rrd-agent/lpar2rrd-agent.pl -d lpar2rrd-rz1
LPAR2RRD agent version:6.01-0
<snip>
Agent send     : yes : forced by -d
Agent send slp: sending wait: 9
OS/HMC agent working for server: lpar2rrd-rz1
store file for sending is /var/tmp/lpar2rrd-agent-lpar2rrd-rz1-lpar2rrd.txt
Tue Jun 25 08:37:04 2019: wrong server response: agent_time:1560945060 : recv_time: :
Tue Jun 25 08:37:04 2019: Error: Not all data has been sent out, refused line: 8408-E8E*1234567:v2db02:13:1560945060:Wed Jun 19 13:51:00 2019 version 6.01-0:3724000000|8:v2db02:0::mem:::25165824:24337552:828272:19829064:0:2345684:pgs:::0:0:7168:1:::lan:en0:192.168.2.6:49461482084212:8113849412151:43661912638:28546913825:::cpu:::0:10:29:0:::san:fcs0:0xC0507609B4E6001A:109933106491344:7859374059840:10667066152:614558976:::san:fcs1:0xC0507609B4E6001C:109938476123413:7857088829200:10641628626:614073144:::san:fcs2:0xC0507609B4E6001E:109925097604425:7859331925280:10637837044:614504076:::san:fcs3:0xC0507609B4E60020:109932498290719:7855272237360:10638242030:614099229:::san_resp:fcs0::0.5:0.8:::::san_resp:fcs1::0.5:0.8:::::san_resp:fcs2::0.5:0.8:::::san_resp:fcs3::0.5:0.8:::::wlm:Unclassified:0.00:7:0.00:sup::::wlm:Unmanaged:0.00:0:0.00:sup::::wlm:Default:14.18:8466:0.00:sup::::wlm:Shared:0.00:243:0.00:sup::::wlm:System:10.37:4327:0.00:sup::::wlm:oninit:7.97:7345:0.00:sup::::wlm:oninit.Default:0.00:0:U:sub::::wlm:oninit.Shared:0.00:0:U:sub::::wlm:oninit.basis_at:5.02:2843:U:sub::::wlm:oninit.db02basis:94.98:4501:U:sub::::wlm:oninit.neptun:0.00:0:U:sub::::wlm:oninit.db02barm:0.00:0:U:sub::::wlm:oninit.barm:0.00:0:U:sub::::wlm:oninit.basis:0.00:0:U:sub::::wlm:oninit.jupiter:0.00:0:U:sub::::wlm:TOTAL:32.52:20388:0.00:sup::: /opt/lpar2rrd-agent/lpar2rrd-agent.pl:3639


At server side this is logged in  error.log-daemon
substr outside of string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2453.
Use of uninitialized value $name_under_wrkdir in split at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2456.
Use of uninitialized value $server in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2460.
Use of uninitialized value $name_under_hmc in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2474.
Tue Jun 25 08:36:48 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//8408-E8E*1234567/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory
Use of uninitialized value $name_under_hmc in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2474.
Tue Jun 25 08:36:48 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//8408-E8E*1234567/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory
Use of uninitialized value $name_under_hmc in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2474.
Tue Jun 25 08:36:48 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//oVirt/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory
Use of uninitialized value $name_under_hmc in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2474.
Tue Jun 25 08:36:48 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//RZ1_AIX059/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory
Use of uninitialized value $name_under_hmc in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2474.
Tue Jun 25 08:36:48 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//RZ2_AIX060/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory
Use of uninitialized value $name_under_hmc in concatenation (.) or string at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 2474.
Tue Jun 25 08:36:48 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//XEN_iostats/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory
Use of uninitialized value $RRDp::error_mode in string eq at /usr/lib64/perl5/vendor_perl/RRDp.pm line 168.
Tue Jun 25 08:36:48 2019: Client communication failed - client:  (192.168.2.6): ERROR: opening '': No such file or directory at /app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 1039.

Any help would be appreciated .. :-)

Comments

  • Pavel
    Pavel
    Hi,

    what is your lpar2rrd server version?
  • joerg
    joerg
    Hi Pavel

    LPAR2RRD version6.02
    LPAR2RRD editionfree
    OS infoLinux
    Perl versionThis is perl 5, version 16, subversion 3 (v5.16.3) built for x86_64-linux-thread-multi
    Web server infoApache/2.4.6 (Red Hat Enterprise Linux)
    RRDTOOL version1.4.8
    RRDp version1.4008


    v2db02# rpm -q lpar2rrd-agent
    lpar2rrd-agent-6.01-0


    Some Info to WLM: We use ist "active", not "Passive" as i wrote first.
    We create a WLM superclass oninit with subclasses basis_at, db02basis, neptun, jupiter.


    I tried some kind of  debugging to cloned lpar2rrd server that had no v6.01 agent data loaded to simulate the first send from v6.01 agent to v6.02 server.

    Here is what is logged to daemon.out, maybe it will help you
    creating wlm-Unclassified.mmm
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unclassified.mmm
    $name_under_wrkdir ,8408-E8E*1234567/rz1hmc1/v2db02/wlm.col,
    $server 8408-E8E*1234567$hmc rz1hmc1 $name_under_hmc v2db02/wlm.col
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unclassified.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unclassified.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unclassified.mmm : 119 : wlm
    000 : wlm 119 : 1561461319:7:0.00:sup
    creating wlm-Unmanaged.mmm
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unmanaged.mmm
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unmanaged.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unmanaged.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Unmanaged.mmm : 128 : wlm
    000 : wlm 128 : 1561461319:0:0.00:sup
    creating wlm-Default.mmm
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Default.mmm
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Default.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Default.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Default.mmm : 137 : wlm
    000 : wlm 137 : 1561461319:18:0.00:sup
    creating wlm-Shared.mmm
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Shared.mmm
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Shared.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Shared.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-Shared.mmm : 146 : wlm
    000 : wlm 146 : 1561461319:240:0.00:sup
    creating wlm-System.mmm
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-System.mmm
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-System.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-System.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-System.mmm : 155 : wlm
    000 : wlm 155 : 1561461319:4557:0.02:sup
    creating wlm-oninit.mmm
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-oninit.mmm
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-oninit.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02 - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-oninit.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/wlm-oninit.mmm : 164 : wlm
    000 : wlm 164 : 1561461319:15788:0.00:sup
    creating wlm-oninit.Default.mmm
    Tue Jun 25 13:15:54 2019: mkdir          : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/wlm-oninit.Default.mmm
    $name_under_wrkdir ,8408-E8E*1234567/rz1hmc1/v2db02/oninit/wlm.col,
    $server 8408-E8E*1234567$hmc rz1hmc1 $name_under_hmc v2db02/oninit/wlm.col
    Tue Jun 25 13:15:34 2019: Updating 2     : 8408-E8E*1234567:v2db02/oninit - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/wlm-oninit.Default.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: Updating 4     : 8408-E8E*1234567:v2db02/oninit - /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/wlm-oninit.Default.mmm - last_rec: 1560344100
    Tue Jun 25 13:15:34 2019: case struc : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/wlm-oninit.Default.mmm : 173 : wlm
    000 : wlm 173 : 1561461319:0:U:sub
    creating wlm-oninit.Shared.mmm
    Tue Jun 25 13:15:54 2019: mkdir          : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/oninit/
    Tue Jun 25 13:15:54 2019: RRD create     : /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit/oninit/wlm-oninit.Shared.mmm
    $name_under_wrkdir ,,
    $server  $hmc  $name_under_hmc
    $base_file_link /app/lpar2rrd/lpar2rrd/data
    Tue Jun 25 13:15:54 2019: hard link      :  --> /app/lpar2rrd/lpar2rrd/data//8408-E8E*1234567/
    Tue Jun 25 13:15:54 2019: Cannot link :/app/lpar2rrd/lpar2rrd/data//8408-E8E*1234567/ : No such file or directory/app/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:2486 : No such file or directory


  • jihampl
    jihampl
    Hello Joerg,

    update LPAR2RRD to new version: https://www.lpar2rrd.com/download/lpar2rrd-6.02-24.tar 

    after that remove this directory: /app/lpar2rrd/lpar2rrd/data/8408-E8E*1234567/rz1hmc1/v2db02/oninit


  • joerg
    joerg
    Hello jihampl,

    thanks a lot for your quick response. I had installed V6.02-24 yesterday.
    After deleting all /var/tmp/lpar2rrd* files at client side every think seems to be OK.
    WLM information is send to LPAR2RRD server and shown in GUI.
     :) 
    Again, thank you very much for your support.

    Best regards
    Joerg
Sign In or Register to comment.

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Register

Categories

In this Discussion