Solaris / OracleVM — forum.xorux.com

after update to 7.20 info from primary domains stopped

owlmind — Thu, 17 Jun 2021 12:25:58 +0000

Hello,

Yesterday we updated lpar2rrd to 7.20. After that agents on primary domains can't send data.

Agent send 20m : sending data now (act_time=1623929700, last_send_time=1623928274, next_time=1623928574, random=5)

Thu Jun 17 17:36:46 2021: wrong server response: agent_time:1623907201 : recv_time:0 :

Thu Jun 17 17:36:46 2021: Error: Not all data has been sent out, refused line: Solaris11:m8-mgt-pd0-kt:cdom/54e8153a-1612-46d8-a5b6-1a316f228894/86ddd708:1623907201:Thu Jun 17 11:20:01 2021 version 6.15-2:|::::m8-mgt-pd0-kt_ldom:54e8153a-1612-46d8-a5b6-1a316f228894/86ddd708:active:16:17179869184:2.2:26916086:2.1::afs-dbo02-sp2_ldom:7e2a59f2-c255-407f-bfb0-eb48b765b12a/84f8d38a:

server

Thu Jun 17 18:21:23 2021:  Cannot mv /home/lpar2rrd/lpar2rrd/data/Solaris--unknown/no_hmc/baw-dbo10-sp2/ /home/lpar2rrd/lpar2rrd/data/Solaris--unknown/no_hmc/m8-mgt-pd0-kt:baw-dbo10-sp2/: File exists/home/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:1421 : File exists
Thu Jun 17 18:21:22 2021:  Cannot mv /home/lpar2rrd/lpar2rrd/data/Solaris--unknown/no_hmc/baw-dbo11-sp1/ /home/lpar2rrd/lpar2rrd/data/Solaris--unknown/no_hmc/m8-mgt-pd0-sh:baw-dbo11-sp1/: File exists/home/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:1421 : File exists
Thu Jun 17 18:16:10 2021:  Cannot mv /home/lpar2rrd/lpar2rrd/data/Solaris/rbo-dbo2-st3/ /home/lpar2rrd/lpar2rrd/data/Solaris/sparc-5lt-ah:rbo-dbo2-st3/: File exists/home/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl:1415 : File exists
[Thu Jun 17 18:11:07 2021] lpar2rrd-daemon.pl: Use of uninitialized value $uuid_ldom_in_file in scalar chomp at /home/lpar2rrd/lpar2rrd/bin/lpar2rrd-daemon.pl line 1367.

Solaris totals graphs

vvassyukov — Thu, 08 Oct 2020 04:13:21 +0000

Hi! We have got an error in solaris totals graphs. Can you help us to fix this problem?

only monitors first 2 netwotk interfaces on solaris

owlmind — Tue, 27 Oct 2020 09:08:03 +0000

Hello,
stor2rrd only monitors net0 and net1. However many productions systems have much more.
Here is output from one of our systems.

ipadm

NAME CLASS/TYPE STATE UNDER ADDR

adm0 ipmp ok -- --

adm0/v4 static ok --

commv0 ipmp ok -- --

commv0/v4 static ok --

data0 ipmp ok -- --

data0/v4 static ok --

lo0 loopback ok -- --

lo0/v4 static ok -- 127.0.0.1/8

lo0/v6 static ok -- ::1/128

net0 ip ok data0 --

net1 ip ok data0 --

net2 ip ok adm0 --

net3 ip ok adm0 --

net4 ip ok commv0 --

net5 ip ok commv0 --

dladm show-phys

LINK MEDIA STATE SPEED DUPLEX DEVICE

net0 Ethernet up 10000 full i40evf0

net1 Ethernet up 10000 full i40evf1

net2 Ethernet up 40000 full vnet0

net3 Ethernet up 40000 full vnet1

net4 Ethernet up 40000 full vnet2

net5 Ethernet up 40000 full vnet3

We have 6 interfaces, which aggregated in 3 ipmp. Would be great to have ability to monitor all of them, including ipmp.

Oracle VM - script crash during work

brykfusitos — Thu, 23 Jul 2020 06:51:42 +0000

Hello,

I added 2 Oracle VM Manager for monitoring in lpar2rrd and i don't have data's in lpar2rrd.

in logs i saw errors like this :

"Use of uninitialized value $RRDp::error_mode in string eq at /usr/lib64/perl5/vendor_perl/RRDp.pm line 168.
Thu Jul 23 08:10:49 2020: RRDp::create read error : /home/lpar2rrd/lpar2rrd/data/OracleVM/vm/0004fb0000060000e91ccaf6a806a049/disk-/dev/mapper/36005076802810d105000000000000082.rrd : ERROR: creating '/home/lpar2rrd/lpar2rrd/da
ta/OracleVM/vm/0004fb0000060000e91ccaf6a806a049/disk-/dev/mapper/36005076802810d105000000000000082.rrd': No such file or directory at /home/lpar2rrd/lpar2rrd/bin/Xorux_lib.pm line 88 : No such file or directory
Thu Jul 23 08:10:49 2020: Unable to create /home/lpar2rrd/lpar2rrd/data/OracleVM/vm/0004fb0000060000e91ccaf6a806a049/disk-/dev/mapper/36005076802810d105000000000000082.rrd : at /home/lpar2rrd/lpar2rrd/bin/OracleVmLoadDataModul
e.pm: line 140 : No such file or directory"

after about 50 errors scripts ends.

before these errors i see one information more:

Updating server net RRD      : /home/lpar2rrd/lpar2rrd/data/OracleVM/server/e2bcdc7c921311e5846dd67c1c6b0b2b/lan-eth12.rrd
orvm-json2rrd.pl : status 0, Thu Jul 23 08:30:47 CEST 2020
/home/lpar2rrd/lpar2rrd/load_oraclevm.sh: line 191:  3013 Alarm clock             wait_time $timeout

I see in browser configuration which servers, vms are discovered but its don't have data and graphs, heatmap, memory etc.

version: OVM Manager are : 3.4.2.1384 and 3.4.6.2622

successfully request - https://server2:port/ovm/core/wsapi/rest/Statistic/Server/8f:da:75:85:e0:16:11:e2:8d:4a:6c:ae:8b:73:c2:64/DISK_READ/range?startTime=1e/wsapi/rest/Statistic/Vm/0004fb0000060000d9733aea35ee5001/NETWORK_RECEIVED/range?startTime=1595484002000&endTime=1595485202000

successfully request - https://server1:port/ovm/core/wsapi/rest/Statistic/Vm/0004fb0000060000281dd7b566791f39/CPU_COUNT/range?startTime=1595484601000&endTime=est - https://server2:port/ovm/core/wsapi/rest/Statistic/Vm/0004fb00000600008694f3c56931dbce/DISK_WRITE/range?startTime=1595484601000&endTime=1595485801000

successfully request - https://server1:port/ovm/core/wsapi/rest/Statistic/Vm/0004fb0000060000281dd7b566791f39/CPU_COUNT/range?startTime=1595482801000&endTime=000919e97600a4e59ce/DISK_READ/range?startTime=1595482801000&endTime=1595484001000

server1, server2 and port - is only word because i can't show you my server name and port

OracleVM discovery issues

Primoz — Thu, 20 Aug 2020 07:59:37 +0000

Hello,

I'm trying to add OracleVM to lpar2rrd (installed appliance, update to latest version).
I manually executed /home/lpar2rrd/lpar2rrd/load_oraclevm.sh to see what is going on:
It goes through "Updating server RRD", "Updating vm net RRD", "Creating RRD" and "Updating server net RRD". Then it gives an error, continued with a listing:

orvm-json2rrd.pl : status 0, Thu Aug 20 08:15:13 CEST 2020

An error occured in lpar2rrd, check /home/lpar2rrd/lpar2rrd/logs/error.log-oraclevm and output of load_oraclevm.sh

$ tail -927 /home/lpar2rrd/lpar2rrd/logs/error.log-oraclevm

Thu Aug 20 08:12:21 2020: Result from OracleVM not success (url-https://10.9.14.250:7002/ovm/core/wsapi/rest/Statistic/Server/30:37:32:37:31:32:5a:43:32:35:35:30:30:30:32:30/FREE_MEMORY/range?startTime=1597902736000&endTime=1597903936000): /home/lpar2rrd/lpar2rrd/bin/orvm-api2json.pl:658 :

Thu Aug 20 08:12:21 2020: Message content: "

Caused by: com.sun.jersey.api.ParamException$PathParamException: java.lang.IllegalArgumentException: No enum constant com.oracle.ovm.mgr.ws.model.Statistic.StatisticType.FREE_MEMORY

Caused by: java.lang.IllegalArgumentException: No enum constant com.oracle.ovm.mgr.ws.model.Statistic.StatisticType.FREE_MEMORY

GEN_000000GEN_000000:An exception occurred during processing: java.lang.IllegalArgumentException: No enum constant com.oracle.ovm.mgr.ws.model.Statistic.StatisticType.FREE_MEMORYGENERAL_UNKNOWN_EXCEPTION"! :

Exiting subroutine via next at /home/lpar2rrd/lpar2rrd/bin/orvm-api2json.pl line 660.

....
There is a bunch of those FREE_MEMORY related messages, then it continues with:

Use of uninitialized value $RRDp::error_mode in string eq at /usr/lib64/perl5/vendor_perl/RRDp.pm line 168.

Thu Aug 20 08:15:11 2020: RRDp::create read error : /home/lpar2rrd/lpar2rrd/data/OracleVM/vm/0004fb000006000005ca27576b8065a9/disk-/dev/mapper/360002ac000000000000000ac0001fdc8.rrd : ERROR: creating '/home/lpar2rrd/lpar2rrd/data/OracleVM/vm/0004fb000006000005ca27576b8065a9/disk-/dev/mapper/360002ac000000000000000ac0001fdc8.rrd': No such file or directory at /home/lpar2rrd/lpar2rrd/bin/Xorux_lib.pm line 88. : No such file or directory

Thu Aug 20 08:15:11 2020: Unable to create /home/lpar2rrd/lpar2rrd/data/OracleVM/vm/0004fb000006000005ca27576b8065a9/disk-/dev/mapper/360002ac000000000000000ac0001fdc8.rrd : at /home/lpar2rrd/lpar2rrd/bin/OracleVmLoadDataModule.pm: line 140 : No such file or directory

Use of uninitialized value $RRDp::error_mode in string eq at /usr/lib64/perl5/vendor_perl/RRDp.pm line 168.

And I suppose there's such a chunk of log for each disk on VMs.
The result is that VM's don't have any data about disks.

Any help appreciated.
Kind regards,
Primoz

Installing agent on clustered hosts

lmalachowski — Mon, 29 Jun 2020 13:30:01 +0000

Hello,
We have 2 Solaris 10 hosts set up in a Solaris cluster, with 6 clustered non-global zones, having shared resources. 2 of the zones are online on the first host, 4 zones are online on the second host.
While installing the lpar2rrd Solaris Sparc agent on a non-clustered host, on a global zone in an LDOM I've noticed, that a not running zone was started in administrative mode, to have the agent installed. This makes me wonder, if the offline zones in the cluster would also be booted? Can it have a negative impact on the zones, like a failover?
Please let me know if you need any additional details.

No data from solaris host

vvassyukov — Mon, 06 Apr 2020 05:47:18 +0000

Hi! We have no longer charts from one of solaris host. Check procedure generates an error:

Mon Apr 6 10:33:50 2020: wrong server response: agent_time:1586147616 : recv_time:0 :

Mon Apr 6 10:33:50 2020: Error: Not all data has been sent out, refused line: .....

graphics shifted from their places

owlmind — Fri, 20 Mar 2020 04:12:48 +0000

Hello,

After we updated agents on our solaris host to the latest version 6.15 all graphics shifted from their places.

IOPS graphs moved to san resp tab, san resp to net, net to FS.

It looks like new data with cpu queue didn't get it's own tab and just shifted all other.
Server version - 6.15.

Solaris IO latency

vvassyukov — Thu, 07 Nov 2019 09:39:35 +0000

Hi! We are using lpar2rrd on VMWare and IBM Power environment, it works great! Recently we have bought a new SPARC M8 server, and sight incorrect IO latency data from solaris ldoms. And also we do not receive data on network traffic from agents.

agent on Solaris 11 with LDOMs

cjen — Fri, 30 Aug 2019 12:36:27 +0000

I have installed the Solaris SPARC agent v 6.01-6 on a T7-4 running Solaris 11.3
I don't understand why it says my LDOM nanes are not valid ?

From error file:

sh: sneep: not found

VERSION 1.20

name=primary is not a valid LDom name

VERSION 1.20

name=gd1 is not a valid LDom name

Rgds
Carsten