Nutanix Kubernetes Platform（NKP）v2.12 の Management Cluster の様子を、記念に残しておきます。
このクラスタは、下記のように作成してあります。
Management Cluster への接続
nkp コマンドで Management Cluster を作成すると、カレント ディレクトリに「＜クラスタ名＞.conf」という名前で、kubeconfig ファイルが作成されます。
[root@lab-nkp-01 ~]# kubectl --kubeconfig=./nkpm01.conf config view
apiVersion: v1
clusters:
- cluster:
certificate-authority-data: DATA+OMITTED
server: https://192.168.12.200:6443
name: nkpm01
contexts:
- context:
cluster: nkpm01
user: nkpm01-admin
name: nkpm01-admin@nkpm01
current-context: nkpm01-admin@nkpm01
kind: Config
preferences: {}
users:
- name: nkpm01-admin
user:
client-certificate-data: DATA+OMITTED
client-key-data: DATA+OMITTED
このファイルで、Kubernetes クラスタに接続できます。
[root@lab-nkp-01 ~]# kubectl --kubeconfig=./nkpm01.conf get nodes NAME STATUS ROLES AGE VERSION nkpm01-dh72h-sxwm5 Ready control-plane 56m v1.29.6 nkpm01-md-0-td65c-k9h78-d7z6g Ready <none> 54m v1.29.6 nkpm01-md-0-td65c-k9h78-m2dnk Ready <none> 55m v1.29.6
ここからは、KUBECONFIG 環境変数に、このファイルを指定しておきます。
[root@lab-nkp-01 ~]# export KUBECONFIG=$(pwd)/nkpm01.conf
nkp コマンド
nkp コマンドでも、kubeconfig ファイルでクラスタに接続できます。
クラスタの情報を取得してみます。
[root@lab-nkp-01 ~]# nkp get clusters --all-namespaces WORKSPACE NAME KUBECONFIG STATUS kommander-workspace host-cluster kommander-self-attach-kubeconfig Joined
このクラスタの、Cluster API での（capiCluster の）名前が「nkpm01」だとわかります。
[root@lab-nkp-01 ~]# nkp get clusters --workspace kommander-workspace host-cluster -o yaml | grep ^spec -A8
spec:
clusterRef:
capiCluster:
name: nkpm01
namespace: default
kubeconfigRef:
name: kommander-self-attach-kubeconfig
namespaceRef:
name: kommander
クラスタの種類が、Management だとわかります。
[root@lab-nkp-01 ~]# nkp cluster type Management
kubectl コマンド
Node
本来のデフォルト（最小）構成は、Control Plane x3台、Worker x4台です。このクラスタはラボ環境むけに台数を減らしてあります。
[root@lab-nkp-01 ~]# kubectl get nodes -o wide NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME nkpm01-dh72h-sxwm5 Ready control-plane 56m v1.29.6 192.168.12.170 <none> Rocky Linux 9.4 (Blue Onyx) 5.14.0-427.31.1.el9_4.x86_64 containerd://1.6.33-d2iq.1 nkpm01-md-0-td65c-k9h78-d7z6g Ready <none> 54m v1.29.6 192.168.12.152 <none> Rocky Linux 9.4 (Blue Onyx) 5.14.0-427.31.1.el9_4.x86_64 containerd://1.6.33-d2iq.1 nkpm01-md-0-td65c-k9h78-m2dnk Ready <none> 55m v1.29.6 192.168.12.177 <none> Rocky Linux 9.4 (Blue Onyx) 5.14.0-427.31.1.el9_4.x86_64 containerd://1.6.33-d2iq.1
Namespace
Cluster API のプロバイダが多い・・・
[root@lab-nkp-01 ~]# kubectl get namespaces NAME STATUS AGE caaph-system Active 53m capa-system Active 53m capg-system Active 53m capi-kubeadm-bootstrap-system Active 53m capi-kubeadm-control-plane-system Active 53m capi-system Active 53m cappp-system Active 53m capv-system Active 53m capvcd-system Active 53m capx-system Active 53m capz-system Active 53m caren-system Active 53m cert-manager Active 55m default Active 58m git-operator-system Active 50m kommander Active 57m kommander-default-workspace Active 43m kommander-flux Active 51m kube-federation-system Active 46m kube-node-lease Active 58m kube-public Active 58m kube-system Active 58m kubecost Active 44m metallb-system Active 58m node-feature-discovery Active 57m ntnx-system Active 58m
Pod
[root@lab-nkp-01 ~]# kubectl get pods -A NAMESPACE NAME READY STATUS RESTARTS AGE caaph-system caaph-controller-manager-7557bfbd76-lf77f 1/1 Running 0 54m capa-system capa-controller-manager-549fff5698-cl7cg 1/1 Running 0 54m capg-system capg-controller-manager-54df78c867-q2fnt 1/1 Running 0 54m capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager-589f87d995-7xwrq 1/1 Running 0 54m capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager-869b46bd8d-zrdkv 1/1 Running 0 54m capi-system capi-controller-manager-7bd8c69994-nsf74 1/1 Running 0 54m cappp-system cappp-controller-manager-6cc595974c-l5dpb 1/1 Running 0 54m capv-system capv-controller-manager-7c6679579f-rcgnx 1/1 Running 0 54m capvcd-system capvcd-controller-manager-647bbc5685-zq5rw 1/1 Running 0 54m capx-system capx-controller-manager-6b4c9976f6-nw7wv 1/1 Running 0 54m capz-system azureserviceoperator-controller-manager-697d757c4b-n5bj2 2/2 Running 0 54m capz-system capz-controller-manager-75c684766c-lfslp 1/1 Running 0 54m caren-system cluster-api-runtime-extensions-nutanix-869f6bc85d-rh492 1/1 Running 0 54m caren-system helm-repository-86c695db8f-lzr55 1/1 Running 0 54m cert-manager cert-manager-c49657b87-2nlfp 1/1 Running 0 56m cert-manager cert-manager-cainjector-7b9b545679-r2f72 1/1 Running 0 56m cert-manager cert-manager-webhook-647c6946df-gh2vf 1/1 Running 0 56m default cluster-autoscaler-0191fb34-518a-7dbf-b110-a753936db3e1-c5rncjv 1/1 Running 0 59m git-operator-system git-operator-controller-manager-585cc87d78-j94gw 2/2 Running 0 51m git-operator-system git-operator-git-0 3/3 Running 0 51m kommander-default-workspace karma-traefik-certs-kommander-default-workspace-cert-feder6b7bw 1/1 Running 0 44m kommander-default-workspace kubecost-traefik-certs-kommander-default-workspace-cert-fetxswm 1/1 Running 0 44m kommander-default-workspace prometheus-traefik-certs-kommander-default-workspace-cert-dfz8p 1/1 Running 0 44m kommander-flux helm-controller-dc4455cd5-j948n 1/1 Running 0 52m kommander-flux kustomize-controller-755bbdfc55-bswgk 1/1 Running 0 52m kommander-flux notification-controller-86c44d47f9-w6kgd 1/1 Running 0 52m kommander-flux source-controller-68bc9cbf4d-cbch9 1/1 Running 0 52m kommander cluster-observer-2360587938-99c9d54bb-z5f8d 1/1 Running 0 43m kommander dex-64cfdf9f79-rbr6w 1/1 Running 0 43m kommander dex-dex-controller-84656677b7-jrw2n 2/2 Running 0 44m kommander dex-k8s-authenticator-5c99d75fd6-9nzsh 1/1 Running 0 43m kommander gatekeeper-audit-57b899b497-wq5zs 1/1 Running 0 49m kommander gatekeeper-controller-manager-84456b75f-cxtf5 1/1 Running 0 49m kommander gatekeeper-controller-manager-84456b75f-szd8v 1/1 Running 0 49m kommander karma-traefik-certs-kommander-cert-federation-54d5d5686f-9n7qr 1/1 Running 0 44m kommander kommander-appmanagement-677d49d6d4-kwrcj 2/2 Running 0 48m kommander kommander-appmanagement-webhook-765c8c99f-46lrb 1/1 Running 0 48m kommander kommander-authorizedlister-69bbb668dc-4rfw2 1/1 Running 0 45m kommander kommander-bootstrap-57rmb 0/1 Completed 0 59m kommander kommander-capimate-cf74f5985-kkhnv 1/1 Running 0 45m kommander kommander-capimate-cf74f5985-s7924 1/1 Running 0 45m kommander kommander-cm-6cdb956ddc-pcdw5 2/2 Running 0 45m kommander kommander-flux-operator-84976cdbd7-csrxw 2/2 Running 0 45m kommander kommander-kommander-ui-85bcfbb455-ftpp2 1/1 Running 0 44m kommander kommander-licensing-cm-79db86b6f9-khz84 2/2 Running 0 45m kommander kommander-licensing-webhook-7dcb9b8bf8-thrft 1/1 Running 0 45m kommander kommander-operator-5ddcf7797f-dzqvj 1/1 Running 0 50m kommander kommander-reloader-reloader-68fb77b665-qjfc2 1/1 Running 0 47m kommander kommander-traefik-7bbc46f4f5-fp4l2 1/1 Running 0 47m kommander kommander-traefik-7bbc46f4f5-wt6qr 1/1 Running 0 47m kommander kommander-webhook-5f46b86487-g2kk5 1/1 Running 0 45m kommander kube-oidc-proxy-6857cff99-vqxh8 1/1 Running 0 43m kommander kubecost-traefik-certs-kommander-cert-federation-5656b5679r8n6s 1/1 Running 0 44m kommander prometheus-traefik-certs-kommander-cert-federation-f4fd44btpcj6 1/1 Running 0 44m kommander runtime-extension-kommander-59d9c676b7-z757h 1/1 Running 0 54m kommander traefik-forward-auth-mgmt-6997675546-9lntj 1/1 Running 0 37m kube-federation-system kubefed-admission-webhook-575c45986d-w7j4q 1/1 Running 0 46m kube-federation-system kubefed-controller-manager-7d5dcdbf8f-9qxgg 1/1 Running 0 46m kube-federation-system kubefed-controller-manager-7d5dcdbf8f-sz67p 1/1 Running 0 46m kube-system cilium-6xdrq 1/1 Running 0 57m kube-system cilium-9d7gc 1/1 Running 0 58m kube-system cilium-operator-58c5d5d6d-686wx 1/1 Running 0 59m kube-system cilium-operator-58c5d5d6d-p484w 1/1 Running 0 59m kube-system cilium-tfp5q 1/1 Running 0 59m kube-system coredns-76f75df574-9hgbt 1/1 Running 0 59m kube-system coredns-76f75df574-dv77q 1/1 Running 0 59m kube-system etcd-nkpm01-dh72h-sxwm5 1/1 Running 0 59m kube-system kube-apiserver-nkpm01-dh72h-sxwm5 1/1 Running 0 59m kube-system kube-controller-manager-nkpm01-dh72h-sxwm5 1/1 Running 0 59m kube-system kube-proxy-9vf7p 1/1 Running 0 59m kube-system kube-proxy-ct8fm 1/1 Running 0 57m kube-system kube-proxy-dlgwb 1/1 Running 0 58m kube-system kube-scheduler-nkpm01-dh72h-sxwm5 1/1 Running 0 59m kube-system kube-vip-nkpm01-dh72h-sxwm5 1/1 Running 0 59m kube-system nutanix-cloud-controller-manager-598b4c7669-99r7g 1/1 Running 1 (58m ago) 59m kube-system snapshot-controller-5c7f9fc58-7w85q 1/1 Running 0 59m metallb-system metallb-controller-94f95d674-64cdn 1/1 Running 0 59m metallb-system metallb-speaker-8z5jx 4/4 Running 0 57m metallb-system metallb-speaker-gk9nz 4/4 Running 0 58m metallb-system metallb-speaker-x8277 4/4 Running 0 56m node-feature-discovery node-feature-discovery-gc-7f54d58d99-vdpfp 1/1 Running 0 59m node-feature-discovery node-feature-discovery-master-ccf75997b-qh7gc 1/1 Running 0 59m node-feature-discovery node-feature-discovery-worker-4mbht 1/1 Running 0 56m node-feature-discovery node-feature-discovery-worker-kj258 1/1 Running 0 58m node-feature-discovery node-feature-discovery-worker-qgg4l 1/1 Running 0 57m ntnx-system nutanix-csi-controller-754fcf5f85-ld2pf 7/7 Running 2 (54m ago) 56m ntnx-system nutanix-csi-controller-754fcf5f85-sdf67 7/7 Running 3 (54m ago) 56m ntnx-system nutanix-csi-node-8zvmz 3/3 Running 0 56m ntnx-system nutanix-csi-node-chm46 3/3 Running 1 (55m ago) 56m ntnx-system nutanix-csi-node-dtb4t 3/3 Running 1 (55m ago) 56m
Deployment
[root@lab-nkp-01 ~]# kubectl get deployment -A NAMESPACE NAME READY UP-TO-DATE AVAILABLE AGE caaph-system caaph-controller-manager 1/1 1 1 102m capa-system capa-controller-manager 1/1 1 1 103m capg-system capg-controller-manager 1/1 1 1 102m capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-controller-manager 1/1 1 1 103m capi-kubeadm-control-plane-system capi-kubeadm-control-plane-controller-manager 1/1 1 1 103m capi-system capi-controller-manager 1/1 1 1 103m cappp-system cappp-controller-manager 1/1 1 1 102m capv-system capv-controller-manager 1/1 1 1 102m capvcd-system capvcd-controller-manager 1/1 1 1 102m capx-system capx-controller-manager 1/1 1 1 102m capz-system azureserviceoperator-controller-manager 1/1 1 1 102m capz-system capz-controller-manager 1/1 1 1 102m caren-system cluster-api-runtime-extensions-nutanix 1/1 1 1 102m caren-system helm-repository 1/1 1 1 102m cert-manager cert-manager 1/1 1 1 104m cert-manager cert-manager-cainjector 1/1 1 1 104m cert-manager cert-manager-webhook 1/1 1 1 104m default cluster-autoscaler-0191fb34-518a-7dbf-b110-a753936db3e1 1/1 1 1 107m git-operator-system git-operator-controller-manager 1/1 1 1 100m kommander-default-workspace karma-traefik-certs-kommander-default-workspace-cert-federation 1/1 1 1 93m kommander-default-workspace kubecost-traefik-certs-kommander-default-workspace-cert-federation 1/1 1 1 93m kommander-default-workspace prometheus-traefik-certs-kommander-default-workspace-cert-federation 1/1 1 1 93m kommander-flux helm-controller 1/1 1 1 100m kommander-flux kustomize-controller 1/1 1 1 100m kommander-flux notification-controller 1/1 1 1 100m kommander-flux source-controller 1/1 1 1 100m kommander cluster-observer-2360587938 1/1 1 1 91m kommander dex 1/1 1 1 95m kommander dex-dex-controller 1/1 1 1 95m kommander dex-k8s-authenticator 1/1 1 1 92m kommander gatekeeper-audit 1/1 1 1 98m kommander gatekeeper-controller-manager 2/2 2 2 98m kommander karma-traefik-certs-kommander-cert-federation 1/1 1 1 92m kommander kommander-appmanagement 1/1 1 1 97m kommander kommander-appmanagement-webhook 1/1 1 1 97m kommander kommander-authorizedlister 1/1 1 1 94m kommander kommander-capimate 2/2 2 2 94m kommander kommander-cm 1/1 1 1 94m kommander kommander-flux-operator 1/1 1 1 94m kommander kommander-kommander-ui 1/1 1 1 92m kommander kommander-licensing-cm 1/1 1 1 94m kommander kommander-licensing-webhook 1/1 1 1 94m kommander kommander-operator 1/1 1 1 98m kommander kommander-reloader-reloader 1/1 1 1 95m kommander kommander-traefik 2/2 2 2 95m kommander kommander-webhook 1/1 1 1 94m kommander kube-oidc-proxy 1/1 1 1 91m kommander kubecost-traefik-certs-kommander-cert-federation 1/1 1 1 92m kommander prometheus-traefik-certs-kommander-cert-federation 1/1 1 1 92m kommander runtime-extension-kommander 1/1 1 1 102m kommander traefik-forward-auth-mgmt 1/1 1 1 85m kube-federation-system kubefed-admission-webhook 1/1 1 1 95m kube-federation-system kubefed-controller-manager 2/2 2 2 95m kube-system cilium-operator 2/2 2 2 107m kube-system coredns 2/2 2 2 107m kube-system nutanix-cloud-controller-manager 1/1 1 1 107m kube-system snapshot-controller 1/1 1 1 107m metallb-system metallb-controller 1/1 1 1 107m node-feature-discovery node-feature-discovery-gc 1/1 1 1 107m node-feature-discovery node-feature-discovery-master 1/1 1 1 107m ntnx-system nutanix-csi-controller 2/2 2 2 104m
DaemonSet
CNI は、Cilium のようです。Load Balancer として、MetalLB が利用されています。
[root@lab-nkp-01 ~]# kubectl get daemonset -A NAMESPACE NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE kube-system cilium 3 3 3 3 3 kubernetes.io/os=linux 109m kube-system kube-proxy 3 3 3 3 3 kubernetes.io/os=linux 109m metallb-system metallb-speaker 3 3 3 3 3 kubernetes.io/os=linux 109m node-feature-discovery node-feature-discovery-worker 3 3 3 3 3 <none> 109m ntnx-system nutanix-csi-node 3 3 3 3 3 kubernetes.io/os=linux 106m
StatefulSet
[root@lab-nkp-01 ~]# kubectl get statefulset -A NAMESPACE NAME READY AGE git-operator-system git-operator-git 1/1 102m
Service
[root@lab-nkp-01 ~]# kubectl get service -A NAMESPACE NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE caaph-system caaph-controller-manager-metrics-service ClusterIP 10.111.108.225 <none> 8443/TCP 62m caaph-system caaph-webhook-service ClusterIP 10.111.170.203 <none> 443/TCP 62m capa-system capa-metrics-service ClusterIP 10.111.199.76 <none> 8080/TCP 62m capa-system capa-webhook-service ClusterIP 10.111.53.197 <none> 443/TCP 62m capg-system capg-webhook-service ClusterIP 10.97.133.228 <none> 443/TCP 62m capi-kubeadm-bootstrap-system capi-kubeadm-bootstrap-webhook-service ClusterIP 10.107.41.51 <none> 443/TCP 62m capi-kubeadm-control-plane-system capi-kubeadm-control-plane-webhook-service ClusterIP 10.111.193.50 <none> 443/TCP 62m capi-system capi-webhook-service ClusterIP 10.110.73.147 <none> 443/TCP 62m cappp-system cappp-webhook-service ClusterIP 10.111.207.57 <none> 443/TCP 62m capv-system capv-webhook-service ClusterIP 10.103.8.69 <none> 443/TCP 62m capvcd-system capvcd-webhook-service ClusterIP 10.109.144.232 <none> 443/TCP 62m capx-system capx-controller-manager-metrics-service ClusterIP 10.107.96.195 <none> 8443/TCP 62m capz-system azureserviceoperator-controller-manager-metrics-service ClusterIP 10.96.211.171 <none> 8080/TCP 62m capz-system azureserviceoperator-proxy-service ClusterIP 10.98.95.82 <none> 8443/TCP 62m capz-system azureserviceoperator-webhook-service ClusterIP 10.106.218.117 <none> 443/TCP 62m capz-system capz-webhook-service ClusterIP 10.110.151.243 <none> 443/TCP 62m caren-system cluster-api-runtime-extensions-nutanix-admission ClusterIP 10.111.103.0 <none> 443/TCP 62m caren-system cluster-api-runtime-extensions-nutanix-runtimehooks ClusterIP 10.106.165.132 <none> 443/TCP 62m caren-system helm-repository ClusterIP 10.109.202.43 <none> 443/TCP 62m cert-manager cert-manager ClusterIP 10.97.107.2 <none> 9402/TCP 64m cert-manager cert-manager-webhook ClusterIP 10.104.97.197 <none> 443/TCP 64m default cluster-autoscaler-0191fb34-518a-7dbf-b110-a753936db3e1 ClusterIP 10.97.60.155 <none> 8085/TCP 67m default kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 67m git-operator-system git-operator-controller-manager-metrics-service ClusterIP 10.106.31.242 <none> 8443/TCP 59m git-operator-system git-operator-git ClusterIP 10.97.215.225 <none> 443/TCP,9443/TCP 59m kommander-flux notification-controller ClusterIP 10.109.204.81 <none> 80/TCP 60m kommander-flux source-controller ClusterIP 10.108.218.2 <none> 80/TCP 60m kommander-flux webhook-receiver ClusterIP 10.110.219.140 <none> 80/TCP 60m kommander dex ClusterIP 10.107.40.161 <none> 32000/TCP 55m kommander dex-dex-controller-manager-metrics-service ClusterIP 10.97.31.147 <none> 8443/TCP 55m kommander dex-dex-controller-webhook-service ClusterIP 10.99.244.134 <none> 443/TCP,18443/TCP 55m kommander dex-k8s-authenticator ClusterIP 10.110.242.129 <none> 5555/TCP 52m kommander gatekeeper-webhook-service ClusterIP 10.103.130.226 <none> 443/TCP 57m kommander kommander ClusterIP 10.100.177.206 <none> 80/TCP 52m kommander kommander-appmanagement-cm-metrics ClusterIP 10.105.151.50 <none> 443/TCP 56m kommander kommander-appmanagement-webhook ClusterIP 10.105.17.181 <none> 443/TCP 56m kommander kommander-authorizedlister ClusterIP 10.101.203.230 <none> 443/TCP 53m kommander kommander-capimate ClusterIP 10.104.65.241 <none> 8443/TCP 53m kommander kommander-cm-metrics ClusterIP 10.100.188.151 <none> 443/TCP 53m kommander kommander-flux-operator-metrics ClusterIP 10.100.89.182 <none> 443/TCP 53m kommander kommander-licensing-cm-metrics ClusterIP 10.104.60.62 <none> 443/TCP 53m kommander kommander-licensing-webhook ClusterIP 10.107.133.180 <none> 443/TCP 53m kommander kommander-traefik LoadBalancer 10.96.235.224 192.168.12.201 8085:32091/TCP,80:30421/TCP,443:32529/TCP 55m kommander kommander-traefik-dashboard ClusterIP 10.104.134.125 <none> 80/TCP 55m kommander kommander-traefik-prometheus ClusterIP 10.111.7.126 <none> 9100/TCP 55m kommander kommander-webhook ClusterIP 10.105.158.197 <none> 443/TCP 53m kommander kube-oidc-proxy ClusterIP 10.102.185.248 <none> 443/TCP 51m kommander runtime-extension-kommander ClusterIP 10.96.202.47 <none> 443/TCP 62m kommander traefik-forward-auth-mgmt ClusterIP 10.96.44.205 <none> 4181/TCP 45m kube-federation-system kubefed-admission-webhook ClusterIP 10.99.212.145 <none> 443/TCP 54m kube-federation-system kubefed-controller-manager-metrics-service ClusterIP 10.98.231.239 <none> 9090/TCP 54m kube-system hubble-peer ClusterIP 10.98.15.57 <none> 443/TCP 67m kube-system kube-dns ClusterIP 10.96.0.10 <none> 53/UDP,53/TCP,9153/TCP 67m metallb-system metallb-webhook-service ClusterIP 10.102.166.70 <none> 443/TCP 66m ntnx-system nutanix-csi-metrics ClusterIP 10.106.231.19 <none> 9809/TCP,9810/TCP,9811/TCP,9812/TCP 64m
Ingress
[root@lab-nkp-01 ~]# kubectl get ingress -A NAMESPACE NAME CLASS HOSTS ADDRESS PORTS AGE git-operator-system git-operator-git kommander-traefik * 192.168.12.201 80 55m kommander dex <none> * 192.168.12.201 80 55m kommander dex-k8s-authenticator <none> * 192.168.12.201 80 52m kommander kommander-kommander-ui <none> * 192.168.12.201 80 52m kommander kube-oidc-proxy <none> * 192.168.12.201 80 50m kommander traefik-dashboard <none> * 192.168.12.201 80 55m kommander traefik-forward-auth-mgmt <none> * 192.168.12.201 80 45m
ダッシュボードは、MetalLB による Load Balancer と、Traefik による Ingress で提供されているようです。
[root@lab-nkp-01 ~]# kubectl get ingress -n kommander kommander-kommander-ui -o yaml | grep ^spec -A50
spec:
rules:
- http:
paths:
- backend:
service:
name: kommander
port:
number: 80
path: /dkp/kommander/dashboard
pathType: Prefix
status:
loadBalancer:
ingress:
- ip: 192.168.12.201
/dkp/traefik/dashboard にアクセスすると、Traefic ダッシュボードも開けます。
Storage Class
[root@lab-nkp-01 ~]# kubectl get storageclass NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE nutanix-volume (default) csi.nutanix.com Delete WaitForFirstConsumer false 81m
PVC / PV
Nutanix Volumes の PV が利用されています。
[root@lab-nkp-01 ~]# kubectl get pvc -A NAMESPACE NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS VOLUMEATTRIBUTESCLASS AGE git-operator-system git-operator-admin-volume Bound pvc-082253f3-af58-466a-9471-995a01722eb8 2Gi RWO nutanix-volume80m git-operator-system git-operator-git-volume Bound pvc-0f9aae09-05fe-49fd-a062-86c173bd582e 10Gi RWO nutanix-volume 80m
おまけ（api-resources）
NKP では Cluster API が利用されていますが、もともとは買収した D2iQ の製品なので、Nutanix だけでなく、AWS、Azure、GCP、vSphere、VCD（VMware Cloud Director）など、さまざまなプラットフォームのプロバイダがインストールされています・・・
[root@lab-nkp-01 ~]# kubectl api-resources NAME SHORTNAMES APIVERSION NAMESPACED KIND bindings v1 true Binding componentstatuses cs v1 false ComponentStatus configmaps cm v1 true ConfigMap endpoints ep v1 true Endpoints events ev v1 true Event limitranges limits v1 true LimitRange namespaces ns v1 false Namespace nodes no v1 false Node persistentvolumeclaims pvc v1 true PersistentVolumeClaim persistentvolumes pv v1 false PersistentVolume pods po v1 true Pod podtemplates v1 true PodTemplate replicationcontrollers rc v1 true ReplicationController resourcequotas quota v1 true ResourceQuota secrets v1 true Secret serviceaccounts sa v1 true ServiceAccount services svc v1 true Service challenges acme.cert-manager.io/v1 true Challenge orders acme.cert-manager.io/v1 true Order clusterresourcesetbindings addons.cluster.x-k8s.io/v1beta1 true ClusterResourceSetBinding clusterresourcesets addons.cluster.x-k8s.io/v1beta1 true ClusterResourceSet helmchartproxies hcp addons.cluster.x-k8s.io/v1alpha1 true HelmChartProxy helmreleaseproxies hrp addons.cluster.x-k8s.io/v1alpha1 true HelmReleaseProxy mutatingwebhookconfigurations admissionregistration.k8s.io/v1 false MutatingWebhookConfiguration validatingwebhookconfigurations admissionregistration.k8s.io/v1 false ValidatingWebhookConfiguration customresourcedefinitions crd,crds apiextensions.k8s.io/v1 false CustomResourceDefinition apiservices apiregistration.k8s.io/v1 false APIService controllerrevisions apps/v1 true ControllerRevision daemonsets ds apps/v1 true DaemonSet deployments deploy apps/v1 true Deployment replicasets rs apps/v1 true ReplicaSet statefulsets sts apps/v1 true StatefulSet appdeployments appdeployment,appdeployments apps.kommander.d2iq.io/v1alpha3 true AppDeployment apps apps.kommander.d2iq.io/v1alpha3 true App clusterapps clusterapp,clusterapps apps.kommander.d2iq.io/v1alpha3 false ClusterApp selfsubjectreviews authentication.k8s.io/v1 false SelfSubjectReview tokenreviews authentication.k8s.io/v1 false TokenReview localsubjectaccessreviews authorization.k8s.io/v1 true LocalSubjectAccessReview selfsubjectaccessreviews authorization.k8s.io/v1 false SelfSubjectAccessReview selfsubjectrulesreviews authorization.k8s.io/v1 false SelfSubjectRulesReview subjectaccessreviews authorization.k8s.io/v1 false SubjectAccessReview authorizedprojects authorizedlister.workspaces.kommander.mesosphere.io/v1alpha1 true Project authorizedworkspaces authorizedlister.workspaces.kommander.mesosphere.io/v1alpha1 false Workspace horizontalpodautoscalers hpa autoscaling/v2 true HorizontalPodAutoscaler cronjobs cj batch/v1 true CronJob jobs batch/v1 true Job eksconfigs eksc bootstrap.cluster.x-k8s.io/v1beta2 true EKSConfig eksconfigtemplates eksct bootstrap.cluster.x-k8s.io/v1beta2 true EKSConfigTemplate kubeadmconfigs bootstrap.cluster.x-k8s.io/v1beta1 true KubeadmConfig kubeadmconfigtemplates bootstrap.cluster.x-k8s.io/v1beta1 true KubeadmConfigTemplate certificaterequests cr,crs cert-manager.io/v1 true CertificateRequest certificates cert,certs cert-manager.io/v1 true Certificate clusterissuers cert-manager.io/v1 false ClusterIssuer issuers cert-manager.io/v1 true Issuer certificatesigningrequests csr certificates.k8s.io/v1 false CertificateSigningRequest ciliumcidrgroups ccg cilium.io/v2alpha1 false CiliumCIDRGroup ciliumclusterwidenetworkpolicies ccnp cilium.io/v2 false CiliumClusterwideNetworkPolicy ciliumendpoints cep,ciliumep cilium.io/v2 true CiliumEndpoint ciliumexternalworkloads cew cilium.io/v2 false CiliumExternalWorkload ciliumidentities ciliumid cilium.io/v2 false CiliumIdentity ciliuml2announcementpolicies l2announcement cilium.io/v2alpha1 false CiliumL2AnnouncementPolicy ciliumloadbalancerippools ippools,ippool,lbippool,lbippools cilium.io/v2alpha1 false CiliumLoadBalancerIPPool ciliumnetworkpolicies cnp,ciliumnp cilium.io/v2 true CiliumNetworkPolicy ciliumnodeconfigs cilium.io/v2alpha1 true CiliumNodeConfig ciliumnodes cn,ciliumn cilium.io/v2 false CiliumNode ciliumpodippools cpip cilium.io/v2alpha1 false CiliumPodIPPool clusterclasses cc cluster.x-k8s.io/v1beta1 true ClusterClass clusters cl cluster.x-k8s.io/v1beta1 true Cluster machinedeployments md cluster.x-k8s.io/v1beta1 true MachineDeployment machinehealthchecks mhc,mhcs cluster.x-k8s.io/v1beta1 true MachineHealthCheck machinepools mp cluster.x-k8s.io/v1beta1 true MachinePool machines ma cluster.x-k8s.io/v1beta1 true Machine machinesets ms cluster.x-k8s.io/v1beta1 true MachineSet providers clusterctl.cluster.x-k8s.io/v1alpha3 true Provider configs config.gatekeeper.sh/v1alpha1 true Config requiredserviceaccountname constraints.gatekeeper.sh/v1beta1 false RequiredServiceAccountName fleetsmembers containerservice.azure.com/v1api20230315preview true FleetsMember managedclusters containerservice.azure.com/v1api20210501 true ManagedCluster managedclustersagentpools containerservice.azure.com/v1api20210501 true ManagedClustersAgentPool awsmanagedcontrolplanes awsmcp controlplane.cluster.x-k8s.io/v1beta2 true AWSManagedControlPlane kubeadmcontrolplanes kcp controlplane.cluster.x-k8s.io/v1beta1 true KubeadmControlPlane kubeadmcontrolplanetemplates controlplane.cluster.x-k8s.io/v1beta1 true KubeadmControlPlaneTemplate rosacontrolplanes rosacp controlplane.cluster.x-k8s.io/v1beta2 true ROSAControlPlane leases coordination.k8s.io/v1 true Lease clusterpropagatedversions core.kubefed.io/v1alpha1 false ClusterPropagatedVersion federatedservicestatuses core.kubefed.io/v1alpha1 true FederatedServiceStatus federatedtypeconfigs ftc core.kubefed.io/v1beta1 true FederatedTypeConfig kubefedclusters kfc core.kubefed.io/v1beta1 true KubeFedCluster kubefedconfigs core.kubefed.io/v1beta1 true KubeFedConfig propagatedversions core.kubefed.io/v1alpha1 true PropagatedVersion authcodes dex.coreos.com/v1 true AuthCode authrequests dex.coreos.com/v1 true AuthRequest connectors dex.coreos.com/v1 true Connector devicerequests dex.coreos.com/v1 true DeviceRequest devicetokens dex.coreos.com/v1 true DeviceToken oauth2clients dex.coreos.com/v1 true OAuth2Client offlinesessionses dex.coreos.com/v1 true OfflineSessions passwords dex.coreos.com/v1 true Password refreshtokens dex.coreos.com/v1 true RefreshToken signingkeies dex.coreos.com/v1 true SigningKey clients dex.mesosphere.io/v1alpha1 true Client connectors dex.mesosphere.io/v1alpha1 true Connector endpointslices discovery.k8s.io/v1 true EndpointSlice gitopsrepositories dispatch.d2iq.io/v1alpha2 true GitopsRepository kommandercores dkp.d2iq.io/v1alpha1 false KommanderCore events ev events.k8s.io/v1 true Event expansiontemplate expansion.gatekeeper.sh/v1beta1 false ExpansionTemplate providers externaldata.gatekeeper.sh/v1beta1 false Provider flowschemas flowcontrol.apiserver.k8s.io/v1 false FlowSchema prioritylevelconfigurations flowcontrol.apiserver.k8s.io/v1 false PriorityLevelConfiguration gitclaims git.nutanix.com/v1alpha1 true GitClaim gitclaimusers git.nutanix.com/v1alpha1 true GitClaimUser volumegroupsnapshotclasses vgsclass,vgsclasses groupsnapshot.storage.k8s.io/v1alpha1 false VolumeGroupSnapshotClass volumegroupsnapshotcontents vgsc,vgscs groupsnapshot.storage.k8s.io/v1alpha1 false VolumeGroupSnapshotContent volumegroupsnapshots vgs groupsnapshot.storage.k8s.io/v1alpha1 true VolumeGroupSnapshot helmreleases hr helm.toolkit.fluxcd.io/v2beta2 true HelmRelease preprovisionedclusters infrastructure.cluster.konvoy.d2iq.io/v1alpha1 true PreprovisionedCluster preprovisionedinventories infrastructure.cluster.konvoy.d2iq.io/v1alpha1 true PreprovisionedInventory preprovisionedmachines infrastructure.cluster.konvoy.d2iq.io/v1alpha1 true PreprovisionedMachine preprovisionedmachinetemplates infrastructure.cluster.konvoy.d2iq.io/v1alpha1 true PreprovisionedMachineTemplate awsclustercontrolleridentities awsci infrastructure.cluster.x-k8s.io/v1beta2 false AWSClusterControllerIdentity awsclusterroleidentities awsri infrastructure.cluster.x-k8s.io/v1beta2 false AWSClusterRoleIdentity awsclusters awsc infrastructure.cluster.x-k8s.io/v1beta2 true AWSCluster awsclusterstaticidentities awssi infrastructure.cluster.x-k8s.io/v1beta2 false AWSClusterStaticIdentity awsclustertemplates awsct infrastructure.cluster.x-k8s.io/v1beta2 true AWSClusterTemplate awsfargateprofiles awsfp infrastructure.cluster.x-k8s.io/v1beta2 true AWSFargateProfile awsmachinepools awsmp infrastructure.cluster.x-k8s.io/v1beta2 true AWSMachinePool awsmachines awsm infrastructure.cluster.x-k8s.io/v1beta2 true AWSMachine awsmachinetemplates awsmt infrastructure.cluster.x-k8s.io/v1beta2 true AWSMachineTemplate awsmanagedclusters awsmc infrastructure.cluster.x-k8s.io/v1beta2 true AWSManagedCluster awsmanagedmachinepools awsmmp infrastructure.cluster.x-k8s.io/v1beta2 true AWSManagedMachinePool azureasomanagedclusters infrastructure.cluster.x-k8s.io/v1alpha1 true AzureASOManagedCluster azureasomanagedclustertemplates infrastructure.cluster.x-k8s.io/v1alpha1 true AzureASOManagedClusterTemplate azureasomanagedcontrolplanes infrastructure.cluster.x-k8s.io/v1alpha1 true AzureASOManagedControlPlane azureasomanagedcontrolplanetemplates infrastructure.cluster.x-k8s.io/v1alpha1 true AzureASOManagedControlPlaneTemplate azureasomanagedmachinepools infrastructure.cluster.x-k8s.io/v1alpha1 true AzureASOManagedMachinePool azureasomanagedmachinepooltemplates infrastructure.cluster.x-k8s.io/v1alpha1 true AzureASOManagedMachinePoolTemplate azureclusteridentities infrastructure.cluster.x-k8s.io/v1beta1 true AzureClusterIdentity azureclusters infrastructure.cluster.x-k8s.io/v1beta1 true AzureCluster azureclustertemplates infrastructure.cluster.x-k8s.io/v1beta1 true AzureClusterTemplate azuremachinepoolmachines ampm infrastructure.cluster.x-k8s.io/v1beta1 true AzureMachinePoolMachine azuremachinepools amp infrastructure.cluster.x-k8s.io/v1beta1 true AzureMachinePool azuremachines infrastructure.cluster.x-k8s.io/v1beta1 true AzureMachine azuremachinetemplates infrastructure.cluster.x-k8s.io/v1beta1 true AzureMachineTemplate azuremanagedclusters amc infrastructure.cluster.x-k8s.io/v1beta1 true AzureManagedCluster azuremanagedclustertemplates amct infrastructure.cluster.x-k8s.io/v1beta1 true AzureManagedClusterTemplate azuremanagedcontrolplanes amcp infrastructure.cluster.x-k8s.io/v1beta1 true AzureManagedControlPlane azuremanagedcontrolplanetemplates amcpt infrastructure.cluster.x-k8s.io/v1beta1 true AzureManagedControlPlaneTemplate azuremanagedmachinepools ammp infrastructure.cluster.x-k8s.io/v1beta1 true AzureManagedMachinePool azuremanagedmachinepooltemplates ammpt infrastructure.cluster.x-k8s.io/v1beta1 true AzureManagedMachinePoolTemplate gcpclusters infrastructure.cluster.x-k8s.io/v1beta1 true GCPCluster gcpclustertemplates gcpct infrastructure.cluster.x-k8s.io/v1beta1 true GCPClusterTemplate gcpmachines infrastructure.cluster.x-k8s.io/v1beta1 true GCPMachine gcpmachinetemplates infrastructure.cluster.x-k8s.io/v1beta1 true GCPMachineTemplate gcpmanagedclusters gcpmc infrastructure.cluster.x-k8s.io/v1beta1 true GCPManagedCluster gcpmanagedcontrolplanes gcpmcp infrastructure.cluster.x-k8s.io/v1beta1 true GCPManagedControlPlane gcpmanagedmachinepools gcpmmp infrastructure.cluster.x-k8s.io/v1beta1 true GCPManagedMachinePool nutanixclusters ncl infrastructure.cluster.x-k8s.io/v1beta1 true NutanixCluster nutanixclustertemplates infrastructure.cluster.x-k8s.io/v1beta1 true NutanixClusterTemplate nutanixmachines nma infrastructure.cluster.x-k8s.io/v1beta1 true NutanixMachine nutanixmachinetemplates nmtmpl infrastructure.cluster.x-k8s.io/v1beta1 true NutanixMachineTemplate rosaclusters rosac infrastructure.cluster.x-k8s.io/v1beta2 true ROSACluster rosamachinepools rosamp infrastructure.cluster.x-k8s.io/v1beta2 true ROSAMachinePool vcdclusters infrastructure.cluster.x-k8s.io/v1beta2 true VCDCluster vcdclustertemplates infrastructure.cluster.x-k8s.io/v1beta2 true VCDClusterTemplate vcdmachines infrastructure.cluster.x-k8s.io/v1beta2 true VCDMachine vcdmachinetemplates infrastructure.cluster.x-k8s.io/v1beta2 true VCDMachineTemplate vsphereclusteridentities infrastructure.cluster.x-k8s.io/v1beta1 false VSphereClusterIdentity vsphereclusters infrastructure.cluster.x-k8s.io/v1beta1 true VSphereCluster vsphereclustertemplates infrastructure.cluster.x-k8s.io/v1beta1 true VSphereClusterTemplate vspheredeploymentzones infrastructure.cluster.x-k8s.io/v1beta1 false VSphereDeploymentZone vspherefailuredomains infrastructure.cluster.x-k8s.io/v1beta1 false VSphereFailureDomain vspheremachines infrastructure.cluster.x-k8s.io/v1beta1 true VSphereMachine vspheremachinetemplates infrastructure.cluster.x-k8s.io/v1beta1 true VSphereMachineTemplate vspherevms infrastructure.cluster.x-k8s.io/v1beta1 true VSphereVM ipaddressclaims ipam.cluster.x-k8s.io/v1beta1 true IPAddressClaim ipaddresses ipam.cluster.x-k8s.io/v1beta1 true IPAddress helmreleasestatuses kommander.d2iq.io/v1alpha1 true HelmReleaseStatus kommanderclusters komm,komms,kommander,kommanders kommander.mesosphere.io/v1beta1 true KommanderCluster licenses kommander.mesosphere.io/v1beta1 true License virtualgroupclusterrolebindings kommander.mesosphere.io/v1beta1 false VirtualGroupClusterRoleBinding virtualgroups kommander.mesosphere.io/v1beta1 false VirtualGroup extensions kubernetesconfiguration.azure.com/v1api20230501 true Extension kustomizations ks kustomize.toolkit.fluxcd.io/v1 true Kustomization bfdprofiles metallb.io/v1beta1 true BFDProfile bgpadvertisements metallb.io/v1beta1 true BGPAdvertisement bgppeers metallb.io/v1beta2 true BGPPeer communities metallb.io/v1beta1 true Community ipaddresspools metallb.io/v1beta1 true IPAddressPool l2advertisements metallb.io/v1beta1 true L2Advertisement servicel2statuses metallb.io/v1beta1 true ServiceL2Status assign mutations.gatekeeper.sh/v1 false Assign assignimage mutations.gatekeeper.sh/v1alpha1 false AssignImage assignmetadata mutations.gatekeeper.sh/v1 false AssignMetadata modifyset mutations.gatekeeper.sh/v1 false ModifySet bastionhosts network.azure.com/v1api20220701 true BastionHost natgateways network.azure.com/v1api20220701 true NatGateway privateendpoints network.azure.com/v1api20220701 true PrivateEndpoint virtualnetworks network.azure.com/v1api20201101 true VirtualNetwork virtualnetworkssubnets network.azure.com/v1api20201101 true VirtualNetworksSubnet ingressclasses networking.k8s.io/v1 false IngressClass ingresses ing networking.k8s.io/v1 true Ingress networkpolicies netpol networking.k8s.io/v1 true NetworkPolicy nodefeaturegroups nfg nfd.k8s-sigs.io/v1alpha1 true NodeFeatureGroup nodefeaturerules nfr nfd.k8s-sigs.io/v1alpha1 false NodeFeatureRule nodefeatures nfd.k8s-sigs.io/v1alpha1 true NodeFeature runtimeclasses node.k8s.io/v1 false RuntimeClass alerts notification.toolkit.fluxcd.io/v1beta3 true Alert providers notification.toolkit.fluxcd.io/v1beta3 true Provider receivers notification.toolkit.fluxcd.io/v1 true Receiver poddisruptionbudgets pdb policy/v1 true PodDisruptionBudget clusterrolebindings rbac.authorization.k8s.io/v1 false ClusterRoleBinding clusterroles rbac.authorization.k8s.io/v1 false ClusterRole rolebindings rbac.authorization.k8s.io/v1 true RoleBinding roles rbac.authorization.k8s.io/v1 true Role resourcegroups resources.azure.com/v1api20200601 true ResourceGroup extensionconfigs ext runtime.cluster.x-k8s.io/v1alpha1 false ExtensionConfig priorityclasses pc scheduling.k8s.io/v1 false PriorityClass replicaschedulingpreferences rsp scheduling.kubefed.io/v1alpha1 true ReplicaSchedulingPreference volumesnapshotclasses vsclass,vsclasses snapshot.storage.k8s.io/v1 false VolumeSnapshotClass volumesnapshotcontents vsc,vscs snapshot.storage.k8s.io/v1 false VolumeSnapshotContent volumesnapshots vs snapshot.storage.k8s.io/v1 true VolumeSnapshot buckets source.toolkit.fluxcd.io/v1beta2 true Bucket gitrepositories gitrepo source.toolkit.fluxcd.io/v1 true GitRepository helmcharts hc source.toolkit.fluxcd.io/v1beta2 true HelmChart helmrepositories helmrepo source.toolkit.fluxcd.io/v1beta2 true HelmRepository ocirepositories ocirepo source.toolkit.fluxcd.io/v1beta2 true OCIRepository constraintpodstatuses status.gatekeeper.sh/v1beta1 true ConstraintPodStatus constrainttemplatepodstatuses status.gatekeeper.sh/v1beta1 true ConstraintTemplatePodStatus expansiontemplatepodstatuses status.gatekeeper.sh/v1beta1 true ExpansionTemplatePodStatus mutatorpodstatuses status.gatekeeper.sh/v1beta1 true MutatorPodStatus csidrivers storage.k8s.io/v1 false CSIDriver csinodes storage.k8s.io/v1 false CSINode csistoragecapacities storage.k8s.io/v1 true CSIStorageCapacity storageclasses sc storage.k8s.io/v1 false StorageClass volumeattachments storage.k8s.io/v1 false VolumeAttachment syncsets syncset.gatekeeper.sh/v1alpha1 false SyncSet constrainttemplates templates.gatekeeper.sh/v1 false ConstraintTemplate ingressroutes traefik.containo.us/v1alpha1 true IngressRoute ingressroutetcps traefik.containo.us/v1alpha1 true IngressRouteTCP ingressrouteudps traefik.containo.us/v1alpha1 true IngressRouteUDP middlewares traefik.containo.us/v1alpha1 true Middleware middlewaretcps traefik.containo.us/v1alpha1 true MiddlewareTCP serverstransports traefik.containo.us/v1alpha1 true ServersTransport tlsoptions traefik.containo.us/v1alpha1 true TLSOption tlsstores traefik.containo.us/v1alpha1 true TLSStore traefikservices traefik.containo.us/v1alpha1 true TraefikService ingressroutes traefik.io/v1alpha1 true IngressRoute ingressroutetcps traefik.io/v1alpha1 true IngressRouteTCP ingressrouteudps traefik.io/v1alpha1 true IngressRouteUDP middlewares traefik.io/v1alpha1 true Middleware middlewaretcps traefik.io/v1alpha1 true MiddlewareTCP serverstransports traefik.io/v1alpha1 true ServersTransport serverstransporttcps traefik.io/v1alpha1 true ServersTransportTCP tlsoptions traefik.io/v1alpha1 true TLSOption tlsstores traefik.io/v1alpha1 true TLSStore traefikservices traefik.io/v1alpha1 true TraefikService federatedclusterrolebindings types.kubefed.io/v1beta1 false FederatedClusterRoleBinding federatedclusterroles types.kubefed.io/v1beta1 false FederatedClusterRole federatedconfigmaps fcm types.kubefed.io/v1beta1 true FederatedConfigMap federatedcustomresourcedefinitions fcrd,fcrds types.kubefed.io/v1beta1 false FederatedCustomResourceDefinition federateddeployments fdeploy types.kubefed.io/v1beta1 true FederatedDeployment federatedingresses fing types.kubefed.io/v1beta1 true FederatedIngress federatedjobs types.kubefed.io/v1beta1 true FederatedJob federatedlimitranges types.kubefed.io/v1beta1 true FederatedLimitRange federatednamespaces fns types.kubefed.io/v1beta1 true FederatedNamespace federatednetworkpolicies fnetpol types.kubefed.io/v1beta1 true FederatedNetworkPolicy federatedreplicasets frs types.kubefed.io/v1beta1 true FederatedReplicaSet federatedresourcequotas types.kubefed.io/v1beta1 true FederatedResourceQuota federatedrolebindings types.kubefed.io/v1beta1 true FederatedRoleBinding federatedroles types.kubefed.io/v1beta1 true FederatedRole federatedsecrets types.kubefed.io/v1beta1 true FederatedSecret federatedserviceaccounts fsa types.kubefed.io/v1beta1 true FederatedServiceAccount federatedservices fsvc types.kubefed.io/v1beta1 true FederatedService kommanderprojectroles workspaces.kommander.mesosphere.io/v1alpha1 true KommanderProjectRole kommanderworkspaceroles workspaces.kommander.mesosphere.io/v1alpha1 true KommanderWorkspaceRole projectroles workspaces.kommander.mesosphere.io/v1alpha1 true ProjectRole projects workspaces.kommander.mesosphere.io/v1alpha1 true Project virtualgroupkommanderclusterrolebindings workspaces.kommander.mesosphere.io/v1alpha1 false VirtualGroupKommanderClusterRoleBinding virtualgroupkommanderprojectrolebindings workspaces.kommander.mesosphere.io/v1alpha1 true VirtualGroupKommanderProjectRoleBinding virtualgroupkommanderworkspacerolebindings workspaces.kommander.mesosphere.io/v1alpha1 true VirtualGroupKommanderWorkspaceRoleBinding virtualgroupprojectrolebindings workspaces.kommander.mesosphere.io/v1alpha1 true VirtualGroupProjectRoleBinding virtualgroupworkspacerolebindings workspaces.kommander.mesosphere.io/v1alpha1 true VirtualGroupWorkspaceRoleBinding workspaceroles workspaces.kommander.mesosphere.io/v1alpha1 true WorkspaceRole workspaces ws,spaces,space workspaces.kommander.mesosphere.io/v1alpha1 false Workspace
以上。
