博客 > 术业专攻> 云计算> kubernetes> Kubernetes学习笔记-手动搭建k8s-1.10.4之部署kube-scheduler 2019年08月29日 11:24:34
本文档介绍部署高可用 kube-scheduler 集群的步骤。
该集群包含 3 个节点,启动后将通过竞争选举机制产生一个 leader 节点,其它节点为阻塞状态。当 leader 节点不可用后,剩余节点将再次进行选举产生新的 leader 节点,从而保证服务的可用性。
为保证通信安全,本文档先生成 x509 证书和私钥,kube-scheduler 在如下两种情况下使用该证书:
配置之前需要先安装kubelet,flannel等组件,不过前边已经安装,现在直接进入配置。
创建证书签名请求:
cat > kube-scheduler-csr.json <
生成证书和私钥:
$cfssl gencert -ca=/etc/kubernetes/cert/ca.pem \
-ca-key=/etc/kubernetes/cert/ca-key.pem \
-config=/etc/kubernetes/cert/ca-config.json \
-profile=kubernetes kube-scheduler-csr.json | cfssljson -bare kube-scheduler
kubeconfig 文件包含访问 apiserver 的所有信息,如 apiserver 地址、CA 证书和自身使用的证书;
$source /opt/k8s/bin/environment.sh
$kubectl config set-cluster kubernetes \
--certificate-authority=/etc/kubernetes/cert/ca.pem \
--embed-certs=true \
--server=${KUBE_APISERVER} \
--kubeconfig=kube-scheduler.kubeconfig
$kubectl config set-credentials system:kube-scheduler \
--client-certificate=kube-scheduler.pem \
--client-key=kube-scheduler-key.pem \
--embed-certs=true \
--kubeconfig=kube-scheduler.kubeconfig
$kubectl config set-context system:kube-scheduler \
--cluster=kubernetes \
--user=system:kube-scheduler \
--kubeconfig=kube-scheduler.kubeconfig
$kubectl config use-context system:kube-scheduler --kubeconfig=kube-scheduler.kubeconfig
分发 kubeconfig 到所有 master 节点:
cat > magic.sh << "EOF"
#!/bin/bash
source /opt/k8s/bin/environment.sh
for node_ip in ${NODE_IPS[@]}
do
echo ">>> ${node_ip}"
scp kube-scheduler.kubeconfig k8s@${node_ip}:/etc/kubernetes/
done
EOF
cat > kube-scheduler.service <
分发 systemd unit 文件到所有 master 节点:
cat > magic.sh << "EOF"
#!/bin/bash
source /opt/k8s/bin/environment.sh
for node_ip in ${NODE_IPS[@]}
do
echo ">>> ${node_ip}"
scp kube-scheduler.service root@${node_ip}:/etc/systemd/system/
done
EOF
cat > magic.sh << "EOF"
#!/bin/bash
source /opt/k8s/bin/environment.sh
for node_ip in ${NODE_IPS[@]}
do
echo ">>> ${node_ip}"
ssh root@${node_ip} "mkdir -p /var/log/kubernetes && chown -R k8s /var/log/kubernetes"
ssh root@${node_ip} "systemctl daemon-reload && systemctl enable kube-scheduler && systemctl start kube-scheduler"
done
EOF
cat > magic.sh << "EOF"
#!/bin/bash
source /opt/k8s/bin/environment.sh
for node_ip in ${NODE_IPS[@]}
do
echo ">>> ${node_ip}"
ssh k8s@${node_ip} "systemctl status kube-scheduler|grep Active"
done
EOF
如果看到如下输出:
$bash magic.sh
>>> 192.168.106.3
Active: active (running) since Fri 2018-11-23 18:31:30 CST; 6h ago
>>> 192.168.106.4
Active: active (running) since Fri 2018-11-23 18:29:32 CST; 6h ago
>>> 192.168.106.5
Active: active (running) since Fri 2018-11-23 18:29:32 CST; 6h ago
则正常,如果失败,看日志:
journalctl -xu kube-scheduler
注意:以下命令在 kube-scheduler 节点上执行。
kube-scheduler 监听 10251 端口,接收 http 请求:
$sudo netstat -lnpt|grep kube-sche
tcp 0 0 127.0.0.1:10251 0.0.0.0:* LISTEN 15377/kube-schedule
$curl -s http://127.0.0.1:10251/metrics |head
# HELP apiserver_audit_event_total Counter of audit events generated and sent to the audit backend.
# TYPE apiserver_audit_event_total counter
apiserver_audit_event_total 0
# HELP go_gc_duration_seconds A summary of the GC invocation durations.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 6.3423e-05
go_gc_duration_seconds{quantile="0.25"} 0.000120079
go_gc_duration_seconds{quantile="0.5"} 0.000146495
go_gc_duration_seconds{quantile="0.75"} 0.000174475
go_gc_duration_seconds{quantile="1"} 0.001807813
$kubectl get endpoints kube-scheduler --namespace=kube-system -o yaml
apiVersion: v1
kind: Endpoints
metadata:
annotations:
control-plane.alpha.kubernetes.io/leader: '{"holderIdentity":"kube-node2_aa57b017-ef0a-11e8-aaf2-5254001a681e","leaseDurationSeconds":15,"acquireTime":"2018-11-23T10:31:09Z","renewTime":"2018-11-23T17:05:31Z","leaderTransitions":1}'
creationTimestamp: 2018-11-23T10:29:32Z
name: kube-scheduler
namespace: kube-system
resourceVersion: "30835"
selfLink: /api/v1/namespaces/kube-system/endpoints/kube-scheduler
uid: aabb2233-ef0a-11e8-9670-525400c7ba97
可见,当前的 leader 为 kube-node2 节点。
随便找一个或两个 master 节点,停掉 kube-scheduler 服务,看其它节点是否获取了 leader 权限(systemd 日志)。
现在就去停掉kube-node2上的kube-scheduler 服务。
$systemctl stop kube-scheduler
$systemctl status kube-scheduler | grep Active
Active: inactive (dead) since Sat 2018-11-24 01:06:40 CST; 14s ago
然后再来查看一下现在的leader是谁:
$kubectl get endpoints kube-scheduler --namespace=kube-system -o yaml
apiVersion: v1
kind: Endpoints
metadata:
annotations:
control-plane.alpha.kubernetes.io/leader: '{"holderIdentity":"kube-node3_aa9017f9-ef0a-11e8-b73d-525400b42484","leaseDurationSeconds":15,"acquireTime":"2018-11-23T17:06:57Z","renewTime":"2018-11-23T17:07:31Z","leaderTransitions":2}'
creationTimestamp: 2018-11-23T10:29:32Z
name: kube-scheduler
namespace: kube-system
resourceVersion: "30984"
selfLink: /api/v1/namespaces/kube-system/endpoints/kube-scheduler
uid: aabb2233-ef0a-11e8-9670-525400c7ba97
可以看到,已经漂移到了kube-node3上去了。
© 2018 www.qingketang.net 鄂ICP备18027844号-1
武汉快勤科技有限公司 13554402156 武汉市东湖新技术开发区关山二路特一号国际企业中心6幢4层7号
扫码关注,全站教程免费播放
订单金额:
支付金额:
支付方式: