Problem with SSH connection

Dariusz

Hello Team, 

I migrated the stor2rrd application from older RHEL 7.9 to 9.3.

All arrays such Dell/Hitachi/HPE woks properly.

I have a problem with connection to SVC/V7000, i've getting "connection closed" in error log and it's all :(

ERROR LOG:

"

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

Connection closed

"

Do you have any idea how i can debug what closing this connection?

 

stor2rrd version: 7.30

linux version: release 9.3 (Plow)

Pavel

upgrade to the latest stor2rrd version, let us know if the problem persists

Dariusz

Dear Pavel,

I upgrade stor2rrd and i see this:

Error: Can't locate object method "new" via package "Net::OpenSSH" at /stor2rrd/stor2rrd/bin/SVC.pm line 2045.

Mon Jul 1 15:48:22 2024 - ERROR  - svcconfig.pl: ERROR: Unable to connect to xxx

 - Return code: 1

Mon Jul 1 15:48:22 2024 - ERROR  - svcconfig.pl:    ssh -v -i /home/stor2rrd/.ssh/id_rsa stor2rrd@xxx "lssystem"

 - Return code: 1

I've found other issue with lenovo v3700 and newer stor version and i was check perl version:

=================

[stor2rrd@xxx:stor2rrd stor2rrd]$ $PERL -MNet::OpenSSH -e 'print "Version: $Net::OpenSSH::VERSION\n"'

Version: 0.80

=================

[stor2rrd@xxx:stor2rrd lib]$ more Xorux/Net/OpenSSH.pm

package Xorux::Net::OpenSSH;

our $VERSION = '0.83';

use strict;

use warnings;

=================

[stor2rrd@xxx:stor2rrd lib]$ more Net/OpenSSH.pm

package Net::OpenSSH;

our $VERSION = '0.80';

use strict;

use warnings;

=================

[stor2rrd@xxx:stor2rrd lib]$ perl -v

This is perl 5, version 32, subversion 1 (v5.32.1) built for x86_64-linux-thread-multi

(with 53 registered patches, see perl -V for more detail)

 Compiled at Nov 27 2023 00:00:00

 %ENV:

  PERL="/usr/bin/perl"

  PERL5LIB="/stor2rrd/stor2rrd/bin:/usr/lib64/perl5:/usr/share/perl5:/usr/lib64/perl5/vendor_perl:/stor2rrd/stor2rrd//lib:/stor2rrd/stor2rrd/lib"

 @INC:

  /stor2rrd/stor2rrd/bin

  /usr/lib64/perl5

  /usr/share/perl5

  /usr/lib64/perl5/vendor_perl

  /stor2rrd/stor2rrd//lib

  /stor2rrd/stor2rrd/lib

  /usr/local/lib64/perl5/5.32

  /usr/local/share/perl5/5.32

  /usr/lib64/perl5/vendor_perl

  /usr/share/perl5/vendor_perl

  /usr/lib64/perl5

  /usr/share/perl5

The command lssystem works properly from error works properly. Other arrays works normally :)

So i'm thinking there is a problem with perl. I can't send you logs, because our policy lock any uploading package outside organization :(

Maybe you have any idea what i should check?

Regards,

Dariusz

Pavel

rpm -qa| grep -i openssh

Dariusz

[root@xxx:stor2rrd ~]# rpm -qa| grep -i openssh

openssh-8.7p1-38.el9.x86_64

openssh-clients-8.7p1-38.el9.x86_64

openssh-server-8.7p1-38.el9.x86_64

perl-Net-OpenSSH-0.82-3.el9.noarch

Dariusz

Maybe there is a option to replace a openssh.pm lib in stor2rrd?

Maybe it would be help?

Pavel

remove this package: perl-Net-OpenSSH-0.82-3.el9.noarch

hereis inclyded 0.80 perl-Net-OpenSSH in lpar2rrd lib.

try connection test again

Dariusz

Still the same

[stor2rrd@xxx:stor2rrd stor2rrd]$ ./bin/config_check.sh V5030_TST

=========================

STORAGE: V5030_TST: SWIZ : sample rate: 300 seconds

=========================

 TCP connection to "xxx" on port "22" is ok

. /stor2rrd/stor2rrd/etc/stor2rrd.cfg; /usr/bin/perl /stor2rrd/stor2rrd/bin/ssh_test_svc.pl xxx stor2rrd "" 30 "sshtest" XXXXX 0

Error: Can't locate object method "new" via package "Net::OpenSSH" at /stor2rrd/stor2rrd/bin/SVC.pm line 2045.

Wed Jul 3 15:08:22 2024 - ERROR  - ssh_test.pl: Unable to connect to remote machine xxx - Return code: 1

 This must work without providing password:

 ssh -v -o ConnectTimeout=80 -o StrictHostKeyChecking=no -o SendEnv=no -i /home/stor2rrd/.ssh/id_rsa_new stor2rrd@xxx"lscurrentuser"

 connection failed!!

And output from command:

[stor2rrd@xxxx:stor2rrd stor2rrd]$ ssh -v -o ConnectTimeout=80 -o StrictHostKeyChecking=no -o SendEnv=no -i /home/stor2rrd/.ssh/id_rsa_new stor2rrd@xxx "lscurrentuser"

OpenSSH_8.7p1, OpenSSL 3.0.7 1 Nov 2022

debug1: Connecting to xxx [xxx] port 22.

debug1: fd 4 clearing O_NONBLOCK

debug1: Connection established.

debug1: identity file /home/stor2rrd/.ssh/id_rsa_new type 0

debug1: identity file /home/stor2rrd/.ssh/id_rsa_new-cert type -1

debug1: Local version string SSH-2.0-OpenSSH_8.7

debug1: Remote protocol version 2.0, remote software version OpenSSH_7.4

debug1: compat_banner: match: OpenSSH_7.4 pat OpenSSH_7.4* compat 0x04000006

debug1: Authenticating to xxx:22 as 'stor2rrd'

debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts: No such file or directory

debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory

debug1: SSH2_MSG_KEXINIT sent

debug1: SSH2_MSG_KEXINIT received

debug1: kex: algorithm: curve25519-sha256

debug1: kex: host key algorithm: ecdsa-sha2-nistp521

debug1: kex: server->client cipher: chacha20-poly1305@openssh.com MAC: <implicit> compression: none

debug1: kex: client->server cipher: chacha20-poly1305@openssh.com MAC: <implicit> compression: none

debug1: kex: curve25519-sha256 need=64 dh_need=64

debug1: kex: curve25519-sha256 need=64 dh_need=64

debug1: expecting SSH2_MSG_KEX_ECDH_REPLY

debug1: SSH2_MSG_KEX_ECDH_REPLY received

debug1: Server host key: ecdsa-sha2-nistp521 SHA256:hm2ushaMZLJsTW9N96DI1U+YPM0uEKRbdKoJDHVDdXM

debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts: No such file or directory

debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory

debug1: Host 'xxx' is known and matches the ECDSA host key.

debug1: Found key in /home/stor2rrd/.ssh/known_hosts:55

debug1: rekey out after 134217728 blocks

debug1: SSH2_MSG_NEWKEYS sent

debug1: expecting SSH2_MSG_NEWKEYS

debug1: SSH2_MSG_NEWKEYS received

debug1: rekey in after 134217728 blocks

debug1: Will attempt key: /home/stor2rrd/.ssh/id_rsa_new RSA SHA256:H/xxxx+8ZJO4 explicit

debug1: SSH2_MSG_EXT_INFO received

debug1: kex_input_ext_info: server-sig-algs=<rsa-sha2-256,rsa-sha2-512>

debug1: SSH2_MSG_SERVICE_ACCEPT received

debug1: Authentications that can continue: publickey,password,keyboard-interactive

debug1: Next authentication method: publickey

debug1: Offering public key: /home/stor2rrd/.ssh/id_rsa_new RSA SHA256:H/xxxx+8ZJO4 explicit

debug1: Server accepts key: /home/stor2rrd/.ssh/id_rsa_new RSA SHA256:H/xxxx+8ZJO4 explicit

Authenticated to xxx ([xxx]:22) using "publickey".

debug1: pkcs11_del_provider: called, provider_id = (null)

debug1: channel 0: new [client-session]

debug1: Requesting no-more-sessions@openssh.com

debug1: Entering interactive session.

debug1: pledge: filesystem full

debug1: client_input_global_request: rtype hostkeys-00@openssh.com want_reply 0

debug1: client_input_hostkeys: searching /home/stor2rrd/.ssh/known_hosts for xxx / (none)

debug1: client_input_hostkeys: searching /home/stor2rrd/.ssh/known_hosts2 for xxx / (none)

debug1: client_input_hostkeys: host key found matching a different name/address, skipping UserKnownHostsFile update

debug1: Remote: Adding to environment: SSH_LABEL_ID=2

debug1: Remote: Adding to environment: SSH_EPOCH=2

debug1: Remote: Adding to environment: SSH_LABEL_ID=2

debug1: Remote: Adding to environment: SSH_EPOCH=2

debug1: Sending environment.

debug1: Sending command: lscurrentuser

name stor2rrd

role Administrator

owner_id

owner_name

debug1: client_input_channel_req: channel 0 rtype exit-status reply 0

debug1: client_input_channel_req: channel 0 rtype eow@openssh.com reply 0

debug1: channel 0: free: client-session, nchannels 1

Transferred: sent 3628, received 3120 bytes, in 0.3 seconds

Bytes per second: sent 11012.1, received 9470.2

debug1: Exit status 0

[stor2rrd@xxxx:stor2rrd stor2rrd]$

Pavel

send us logs

Note a short problem description in the text field of the upload form.

cd /home/stor2rrd/stor2rrd # or where is your STOR2RRD working dir

tar cvhf logs.tar logs tmp/*txt

gzip -9 logs.tar

Send us logs.tar.gz via https://upload.stor2rrd.com

Dariusz

Hi,

As i say few messages earlier:

" I can't send you logs, because our policy lock any uploading package outside organization :("

Our security locs all zips/tar/gz/etc. ;(

So thanks for trying to help me, i will try to found where is the problem. If i will find i will put to forum information :)

Have a good day!

Dariusz

Pavel

are you at the latest stor2rrd version 7.90?

Dariusz

Yes. i downloaded from stor2rrd official web page - https://stor2rrd.com/download.php

Maybe the old configuration is blocking, this instance have few years...

it remember configuration from file ./etc/storage-list.cfg

i will try to remove one array (all data) and then try to add like a fresh array :)

Regards,

Dariusz

Pavel

not necessary, just upgrade

etc/storage-list.cfg is not being used