integration of SAN fails
Hello All,
I am trying to configure stor2rrd and sannav .
I am getting this error
API host network connection:OK
TCP connection to x.x.x.x is OK.
Crontab test:Warning
WARNING: SANNAV agent is not scheduled in crontab Put there this line as per documentation (under user: stor2rrd) : crontab -e 0,5,10,15,20,25,30,35,40,45,50,55 * * * * /stor2rrd/stor2rrd/load_sannavperf.sh > /stor2rrd/stor2rrd/logs/load_sannavperf.out 2>&1 Ignore it if you have just done in past 5 - 10 minutes
KAFKA network connection (usually on the same machine as STOR2RRD):OK
TCP connection to x.x.x.x:8081 is OK.
TCP connection to x.x.x.x :9092 is OK.
API authorization:OK
Switches : 63 Fabrics : 36
Kafka data test:NOK
Kafka consumer daemon is not running (sannavperf.py 172.26.42.65). Try this connection test again after 10 minutes.
Comments
-
Hi shimaore,
it looks like the Kafka consumer is failing. Can you send us logs?
Note a short problem description in the text field of the upload form.
cd /home/stor2rrd/stor2rrd # or where is your STOR2RRD working dir tar cvhf logs.tar logs tmp/*txt gzip -9 logs.tar
Send us logs.tar.gz via https://upload.stor2rrd.com
-
Thanks Karel,
I just uploaded the logs
-
Hi all,
Kafka consumer daemon didn't work because there were old versions of librdkafka and kafkian.
The issue was resolved after reinstalling librdkafka and kafian to the latest versions.
You can identify this issue by this error in the kafka consumer error log:
cd /home/stor2rrd/stor2rrd # or where is your STOR2RRD working dir cat logs/error.log-kafka-consumer-<Kafka hostname or IP> Traceback (most recent call last): File "/stor2rrd/stor2rrd/bin/sannavperf.py", line 51, in <module> value_deserializer=AvroDeserializer(schema_registry_url=f'http://{ip}:{schema_port}'), File "/usr/lib64/python3.6/site-packages/kafkian/consumer.py", line 76, in __init__ self._consumer_impl = self._init_consumer_impl(config) File "/usr/lib64/python3.6/site-packages/kafkian/consumer.py", line 81, in _init_consumer_impl return ConfluentConsumer(config, logger=logging.getLogger("librdkafka.consumer")) cimpl.KafkaException: KafkaError{code=_INVALID_ARG,val=-186,str="Property "throttle_cb" must be set through dedicated .._set_..() function"} Error in atexit._run_exitfuncs: Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/kafkian/consumer.py", line 117, in _close self._consumer_impl.close() AttributeError: 'Consumer' object has no attribute '_consumer_impl'
Here are versions we're using in our labs:
rpm -qa | grep -i kafka
librdkafka1-1.9.0-1.cflt.el7.x86_64
librdkafka-devel-1.9.0-1.cflt.el7.x86_64
pip3 show kafkian
Name: kafkian
Version: 0.13.0
Summary: Opinionated Kafka Python client on top of Confluent python library
Home-page: https://github.com/saabeilin/kafkian
Author: Sergei Beilin
Author-email: saabeilin@gmail.com
License: Apache 2.0
Location: /home/stor2rrd/.local/lib/python3.6/site-packages
Requires: avro-python3, fastavro, confluent-kafka
pip3 show avro-python3
Name: avro-python3
Version: 1.10.2
Summary: Avro is a serialization and RPC framework.
Home-page: https://avro.apache.org/
Author: Apache Avro
Author-email: dev@avro.apache.org
License: Apache License 2.0
Location: /home/stor2rrd/.local/lib/python3.6/site-packages
Requires:
pip3 show fastavro
Name: fastavro
Version: 1.4.7
Summary: Fast read/write of AVRO files
Home-page: https://github.com/fastavro/fastavro
Author: Miki Tebeka
Author-email: miki.tebeka@gmail.com
License: MIT
Location: /home/stor2rrd/.local/lib/python3.6/site-packages
Requires:
pip3 show confluent-kafka
Name: confluent-kafka
Version: 1.8.2
Summary: Confluent's Python client for Apache Kafka
Home-page: https://github.com/confluentinc/confluent-kafka-python
Author: Confluent Inc
Author-email: support@confluent.io
License: UNKNOWN
Location: /home/stor2rrd/.local/lib/python3.6/site-packages
Requires:
Howdy, Stranger!
Categories
- 1.6K All Categories
- 48 XORMON NG
- 25 XORMON
- 153 LPAR2RRD
- 13 VMware
- 16 IBM i
- 2 oVirt / RHV
- 4 MS Windows and Hyper-V
- Solaris / OracleVM
- XenServer / Citrix
- Nutanix
- 7 Database
- 2 Cloud
- 10 Kubernetes / OpenShift / Docker
- 123 STOR2RRD
- 19 SAN
- 7 LAN
- 17 IBM
- 3 EMC
- 12 Hitachi
- 5 NetApp
- 15 HPE
- Lenovo
- 1 Huawei
- 2 Dell
- Fujitsu
- 2 DataCore
- INFINIDAT
- 3 Pure Storage
- Oracle