AIX LPAR all vscsi adapters not showing

philp
philp
in LPAR2RRD
Hi,

One some of our AIX LPARS which are vio clients, we do not see all the vscsi adapters in LPAR2RRD. Looking in the data directory for the LPAR I see

-rw-r--r--    2 lpar2rrd staff             1 Jun 25 07:31 san-vscsi4.cfg
-rw-r--r--    2 lpar2rrd staff       3825736 Jun 25 09:29 san-vscsi4.mmm
-rw-r--r--    2 lpar2rrd staff             1 Jun 25 07:31 san-vscsi6.cfg
-rw-r--r--    2 lpar2rrd staff       3825736 Jun 25 09:29 san-vscsi6.mmm
-rw-r--r--    2 lpar2rrd staff       1913208 Jun 25 09:29 san_resp-vscsi4.mmm
-rw-r--r--    2 lpar2rrd staff       1913208 Jun 25 09:29 san_resp-vscsi6.mmm

but vscsi5 and vscsi7 are missing. How do I get lpar2rrd to pick up the other vscsi adapters please ?

(from nmon)

xName          %busy     read    write        xfers Disks Adapter-Type                                       x
xvscsi7          4.0   1535.4      0.0 KB/s   127.9 9     Virtual SCSI Client A                              x
xvscsi6         44.0   6141.5   4094.3 KB/s   895.6 9     Virtual SCSI Client A                              x
xvscsi5         20.0   5117.9    447.8 KB/s   447.8 10    Virtual SCSI Client A                              x
xvscsi4         16.0   4094.3    255.9 KB/s   255.9 10    Virtual SCSI Client A                              x
xTOTALS  4 adapters   16889.0   4798.0 KB/s  1727.3 19    TOTAL(MB/s)=21.2                                   x

Comments

  • Pavel
    Pavel
    Hi,

    are these adapters listed in below output?

    iostat -Dsal 10 1


  • philp
    philp
    iostat -Dsal 10 1|grep vscsi
    vscsi7                  0.1  82.3   78.9    3.4            3  78.9   0.5    0.2    2.4    3.4   0.6    0.3    1.1    0.0    0.0    0.0    0.0   0.0   0.0
    vscsi6                  0.6 618.5  131.6  486.9            2 131.6   0.5    0.1    4.6  486.9   0.3    0.2    5.9    0.0    0.0    0.0    0.0   0.0   0.0
    vscsi5                  0.9 908.4  626.5  281.9            3 626.5   0.4    0.1    4.1  281.9   0.3    0.2    3.0    0.0    0.0    0.0    0.0   0.0   0.0
    vscsi4                  0.3 338.4  324.6   13.8            2 324.6   0.4    0.1    4.5   13.8   0.5    0.2    1.5    0.0    0.0    0.0    0.0   0.0   0.0


  • Pavel
    Pavel
    Hi,

    on the VIO side:


    cd /var/tmp
    ls -ltr lpar2rrd*
    tail lpar2rrd*err
    tail lpar2rrd*txt   # 3 files will be there, use the one without "ps" and "fs" in its name

    place outpu here of send it to us via support@lpar2rrd.com
  • philp
    philp
    On further investigation it appears that all the vscsi adapters from one VIO server are missing from every lpar. The last entry in the ".err" file was May 22nd. The following is the last line from the agent.txt as requested

    <machine>:<vio_name>:3:1561556460:Wed Jun 26 13:41:00 2019 version 5.05-8:3400000000|8:<vio_name>:0::mem:::6291456:4302084:1989372:2382008:0:1682876:pgs:::0:0:2048:1:::sea:ent0:ent9:24979625658:25009341187:150222086:198822214:::lan:en9:<ip_address>:27129373754:37155476101:153268148:216026396:::cpu:::0:1:0:0:::san:fcs0:0x200000109B5C9258:45461130861779:415840964124:588981889:26320052:::san:fcs2:0x200000109B5C768F:46190460467556:430386830876:592590810:27072505:::san_resp:fcs0::1.1:2.2:::::san_resp:fcs2::1.1:2.2::::

  • philp
    philp
    From the client lpar2rrd-agent.txt

    <machine>:<vio_client_name>:5:1561557060:Wed Jun 26 15:51:00 2019 version 5.05-8:3400000000|8:<vio_client_name>:0::mem:::16777216:12113736:4663480:2900188:0:8947932:pgs:::0:0:10240:0:::lan:en0:<ip_address>:6807473341251:126020233983:445773200:625224674:::cpu:::0:0:0:0:::san:vscsi4::18000:5900:0.2:1.3:::san_resp:vscsi4::2.1:0.4:::::san:vscsi6::0:0:0:0:::san_resp:vscsi6::0.0:0.0::::

    As you can see vscsi5 & vscsi7 are missing



  • philp
    philp
    edited June 2019
    Another check shows that this seems to be across many lpars.
    Looking at the output of "iostat -Dsal" it appears that the vscsi output is split across 2 sections, not together and the client parsing is only picking up the last entry  e.g.
    Vadapter:                        xfers                                 read                        write                              queue              
    -------------------- --------------------------------------- -------------------------- -------------------------- --------------------------------------
                           Kbps   tps bkread bkwrtn partition-id   rps    avg    min    max   wps    avg    min    max    avg    min    max   avg   avg  serv
                                                                         serv   serv   serv         serv   serv   serv   time   time   time  wqsz  sqsz qfull
    vscsi3                  0.0   1.5    1.5    0.0            2   1.5   2.4    0.0    0.0    0.0  51.4    7.0   10.6    7.1M   0.0    0.0    0.0   0.0   0.0


    Vadapter:                        xfers                                 read                        write                              queue              
    -------------------- --------------------------------------- -------------------------- -------------------------- --------------------------------------
                           Kbps   tps bkread bkwrtn partition-id   rps    avg    min    max   wps    avg    min    max    avg    min    max   avg   avg  serv
                                                                         serv   serv   serv         serv   serv   serv   time   time   time  wqsz  sqsz qfull
    vscsi2                  0.0   4.8    4.8    0.0            3   4.8   2.3    0.0    0.0    0.0  27.4    7.0   10.6    2.5M   0.0    0.0    0.0   0.0   0.0


    So only vscsi2 is picked up. I'll continue to check this

  • Pavel
    Pavel
    Hi,

    can you send us complete iostat -Dsal 60 1

    support@stor2rrd.com
  • philp
    philp
    Email sent to the above address. Hopefully it explains the issue fully.
  • skol
    skol

    Hello

    We have the same issue. Most LPARs are showing only one vscsi adapter even we have traffic over both.

    We just updated to 6.15 but still the same.

    Regards Stefan

  • Pavel
    Pavel
    HI,

    is traffic reported even by iostat via more adapters ?
    iostat -Dsal

  • skol
    skol
    Hi Pavel

    Yes - they are in there:
    root@xxxxxxx  [/root]
    # iostat -Dsal

    System configuration: lcpu=32 drives=7 paths=14 vdisks=2 tapes=0

    System: xxxxxxx
                               Kbps      tps    Kb_read   Kb_wrtn
          Physical           8305.5     109.9   76221193869  15584319485

    Vadapter:                        xfers                                 read                        write                              queue
    -------------------- --------------------------------------- -------------------------- -------------------------- --------------------------------------
                           Kbps   tps bkread bkwrtn partition-id   rps    avg    min    max   wps    avg    min    max    avg    min    max   avg   avg  serv
                                                                         serv   serv   serv         serv   serv   serv   time   time   time  wqsz  sqsz qfull
    vscsi1                  0.1  78.4   60.9   17.4            3  60.9   1.1    0.2    1.0   17.4   2.8    0.4    8.9    0.3    0.0    0.0    0.0   0.0   0.0


    Vadapter:                        xfers                                 read                        write                              queue
    -------------------- --------------------------------------- -------------------------- -------------------------- --------------------------------------
                           Kbps   tps bkread bkwrtn partition-id   rps    avg    min    max   wps    avg    min    max    avg    min    max   avg   avg  serv
                                                                         serv   serv   serv         serv   serv   serv   time   time   time  wqsz  sqsz qfull
    vscsi0                  0.0   3.4    2.3    1.1            4   2.3   0.6    0.0    0.0    1.1   1.4    0.5    1.2    0.0    0.0    0.0    0.0   0.0   0.0

  • Pavel
    Pavel
    Hi,

    send us
    1. screenshot from  the UI

    2. on the agent side, this output
    /usr/bin/perl /opt/lpar2rrd-agent/lpar2rrd-agent.pl -d test




  • skol
    skol
    Hi,
    Data uploaded.

Sign In or Register to comment.

Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Register

Categories

In this Discussion