Cant get data from Kubernetes Cluster

Hi,

please send logs:

cd /home/lpar2rrd/lpar2rrd # or your LPAR2RRD working dir
tar cvhf logs.tar logs tmp/*txt tmp/*json data/Kubernetes/*json
gzip -9 logs.tar

 Send us logs.tar.gz via https://upload.lpar2rrd.com

Hi Ricardo,

please send the output:

export APISERVER=<k8s_cluster_adress>

export TOKEN=<token>

curl -X GET $APISERVER/apis/metrics.k8s.io/v1beta1/pods --header "Authorization: Bearer $TOKEN" --insecure

and check if metrics-server is running:

kubectl get pods -n kube-system

Hi Ricardo,

you need to have Kubernetes metrics-server installed - https://github.com/kubernetes-sigs/metrics-server

Look in the "Installation" section - https://github.com/kubernetes-sigs/metrics-server#installation

Im running into a similar error, where I can API auth is OK but won't load the namespaces. I followed this https://lpar2rrd.com/Kubernetes-performance-monitoring-install.php#Kubernetes and my metrics-server is running and reports back top pod and top node information. I ran curl -X GET $APISERVER/apis/metrics.k8s.io/v1beta1/pods --header "Authorization: Bearer $TOKEN" --insecure with my $APISERVER and $TOKEN info and this is the error that comes back.

# curl -X GET $APISERVER/apis/metrics.k8s.io/v1beta1/pods --header "Authorization: Bearer $TOKEN" --insecure

{

 "kind": "Status",

 "apiVersion": "v1",

 "metadata": {},

 "status": "Failure",

 "message": "pods.metrics.k8s.io is forbidden: User \"system:serviceaccount:kube-system:lpar2rrd\" cannot list resource \"pods\" in API group \"metrics.k8s.io\" at the cluster scope",

 "reason": "Forbidden",

 "details": {

  "group": "metrics.k8s.io",

  "kind": "pods"

 },

 "code": 403

clusterrole looks good.

# kubectl describe clusterrole lpar2rrd         Name:     lpar2rrd

Labels:    <none>

Annotations: <none>

PolicyRule:

 Resources          Non-Resource URLs Resource Names Verbs

 ---------          ----------------- -------------- -----

 endpoints          []         []       [get watch list]

 namespaces         []         []       [get watch list]

 nodes/proxy         []         []       [get watch list]

 nodes            []         []       [get watch list]

 pods            []         []       [get watch list]

 services          []         []       [get watch list]

 endpoints.metrics.k8s.io  []         []       [get watch list]

 namespaces.metrics.k8s.io  []         []       [get watch list]

 nodes.metrics.k8s.io/proxy []         []       [get watch list]

 nodes.metrics.k8s.io    []         []       [get watch list]

 pods.metrics.k8s.io     []         []       [get watch list]

 services.metrics.k8s.io   []         []       [get watch list]

               [/metrics]     []       [get]