Orphaned iostat run away consuming excessive cpu
Hi All,
I have noticed the following behaviour on all the versions of lpar2rrd agent on AIX.
Randomly we get a case of orphaned iostat processes that runaway and consume a lot of cpu.
What I believe may be the cause, is if the lpar2rrd server that the agent is sending information to is rebooted, then the lpar2rrd agents get into some weird state and disconnect the iostat and orphan it.
When I get this issue, it is usually a whole bunch of systems simultaneously, but not all systems.
The impact is pretty severe when it is on a virtual IO server.
Any thoughts.
I have noticed the following behaviour on all the versions of lpar2rrd agent on AIX.
Randomly we get a case of orphaned iostat processes that runaway and consume a lot of cpu.
What I believe may be the cause, is if the lpar2rrd server that the agent is sending information to is rebooted, then the lpar2rrd agents get into some weird state and disconnect the iostat and orphan it.
When I get this issue, it is usually a whole bunch of systems simultaneously, but not all systems.
The impact is pretty severe when it is on a virtual IO server.
Any thoughts.
Comments
-
Hi,iostat is not our tool, we use it as per its documentation, nothing special.iostat -Dsal 60 1we have not got reported such behaviour.What I suspect are either hdisk or fcs adapters in strange status, just a guess ...Involve AIX support, it is AIX issue in fact, we are not able to help you.let us know if you get anything from support.let us know if you want to skip iostat in the agent (you miss adapter stats them), we would create special build for you or better implemented some parametr in the agent ...
Howdy, Stranger!
Categories
- 1.6K All Categories
- 43 XORMON NG
- 25 XORMON
- 152 LPAR2RRD
- 13 VMware
- 16 IBM i
- 2 oVirt / RHV
- 4 MS Windows and Hyper-V
- Solaris / OracleVM
- XenServer / Citrix
- Nutanix
- 7 Database
- 2 Cloud
- 10 Kubernetes / OpenShift / Docker
- 122 STOR2RRD
- 19 SAN
- 7 LAN
- 17 IBM
- 3 EMC
- 12 Hitachi
- 5 NetApp
- 15 HPE
- Lenovo
- 1 Huawei
- 1 Dell
- Fujitsu
- 2 DataCore
- INFINIDAT
- 3 Pure Storage
- Oracle