k8s,Kubernetes环境搭建，集群搭建，1个mster，2个node

于 2019-04-11 14:13:03 发布 664 收藏
原文链接：http://blog.51cto.com/12708233/2377148
版权

安装虚拟机

1.安装3台虚拟机，或者使用其他物理机都OK；
2.三台IP地址分别为：192.168.222.135,192.168.222.139,192.168.222.140
2.设置hostname，master节点设置

hostnamectl set-hostname master

3.两个node节点设置

hostnamectl set-hostname node1

4.退出shell重新登录

安装组件

1.在三台服务器上都安装docker、kubelet、kubeadm、kubectl，这里有个脚本，大家可以拿来使用。

  1.  ~]# vi setup.sh
  2.  以下内容复制进文件
  3.  #/bin/sh
  4.  
  5. # install some tools
  6. sudo yum install -y vim telnet bind-utils wget
  7.  
  8. sudo bash -c 'cat <<EOF > /etc/yum.repos.d/kubernetes.repo
  9. [kubernetes]
  10. name=Kubernetes
  11. baseurl=http://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64
  12. enabled=1
  13. gpgcheck=1
  14. repo_gpgcheck=1
  15. gpgkey=http://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg http://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
  16. EOF'
  17.  
  18. # install and start docker
  19. sudo yum install -y docker
  20. sudo systemctl enable docker && sudo systemctl start docker
  21. # Verify docker version is 1.12 and greater.
  22.  
  23. sudo setenforce 0
  24.  
  25. # install kubeadm, kubectl, and kubelet.
  26. sudo yum install -y kubelet kubeadm kubectl
  27.  
  28. sudo bash -c 'cat <<EOF >  /etc/sysctl.d/k8s.conf
  29. net.bridge.bridge-nf-call-ip6tables = 1
  30. net.bridge.bridge-nf-call-iptables = 1
  31. net.ipv4.ip_forward=1
  32. EOF'
  33. sudo sysctl --system
  34.  
  35. sudo systemctl stop firewalld
  36. sudo systemctl disable firewalld
  37. sudo swapoff -a
  38. sudo systemctl enable kubelet && sudo systemctl start kubelet

2.将setup.sh复制到另外两台服务器上

  1. scp setup.sh root@192.168.222.139:/root/
  2. scp setup.sh root@192.168.222.140:/root/

3.分别在三台服务器上执行这个脚本,脚本其实就是安装一些组件，大家都应该能看得懂。

sh setup.sh

安装确认

分别在三台机器上运行以下命令，确认是否安装完毕需要的组件

  1. [root@node2 ~]# which kubeadm
  2. /usr/bin/kubeadm
  3. [root@node2 ~]# which kubelet
  4. /usr/bin/kubelet
  5. [root@node2 ~]# which kubectl
  6. /usr/local/bin/kubectl
  7. [root@node2 ~]# docker version
  8. Client:
  9.  Version:         1.13.1
  10.  API version:     1.26
  11.  Package version: docker-1.13.1-94.gitb2f74b2.el7.centos.x86_64
  12.  Go version:      go1.10.3
  13.  Git commit:      b2f74b2/1.13.1
  14.  Built:           Tue Mar 12 10:27:24 2019
  15.  OS/Arch:         linux/amd64
  16.  
  17. Server:
  18.  Version:         1.13.1
  19.  API version:     1.26 (minimum version 1.12)
  20.  Package version: docker-1.13.1-94.gitb2f74b2.el7.centos.x86_64
  21.  Go version:      go1.10.3
  22.  Git commit:      b2f74b2/1.13.1
  23.  Built:           Tue Mar 12 10:27:24 2019
  24.  OS/Arch:         linux/amd64
  25.  Experimental:    false

确认没问题后进入下一个步骤

master配置

1.主节点上进行kubeadmin init

  1. sudo kubeadm init --pod-network-cidr 172.100.0.0/16 --apiserver-advertise-address 192.168.222.135 
  2. #--pod-network-cidr：pod节点的网段
  3. #--apiserver-advertise-address：apiserver的IP地址，这里写成master节点的IP即可
  4. #-**-apiserver-cert-extra-sans: 如果需要使用公网IP，加上这一条，并且后面加上你的公网IP地址**

2.如果发现拉取镜像失败，我是拉取失败了~~~~ 所以去百度了一下，我们通过 docker.io/mirrorgooglecontainers 中转一下，运行以下命令，直接复制即可

  1. kubeadm config images list |sed -e 's/^/docker pull /g' -e 's#k8s.gcr.io#docker.io/mirrorgooglecontainers#g' |sh -x
  2. docker images |grep mirrorgooglecontainers |awk '{print "docker tag ",$1":"$2,$1":"$2}' |sed -e 's#docker.io/mirrorgooglecontainers#k8s.gcr.io#2' |sh -x
  3. docker images |grep mirrorgooglecontainers |awk '{print "docker rmi ", $1":"$2}' |sh -x
  4. docker pull coredns/coredns:1.2.2
  5. docker tag coredns/coredns:1.2.2 k8s.gcr.io/coredns:1.3.1
  6. docker rmi coredns/coredns:1.2.2

查看镜像列表，没毛病，如果发现init还报错的话，按照kubeadm的报错信息更改下docker镜像的tag，具体各位百度下吧

  1. [root@master ~]# docker images
  2. REPOSITORY                           TAG                 IMAGE ID            CREATED             SIZE
  3. k8s.gcr.io/kube-proxy                v1.14.1             20a2d7035165        2 days ago          82.1 MB
  4. k8s.gcr.io/kube-apiserver            v1.14.1             cfaa4ad74c37        2 days ago          210 MB
  5. k8s.gcr.io/kube-controller-manager   v1.14.1             efb3887b411d        2 days ago          158 MB
  6. k8s.gcr.io/kube-scheduler            v1.14.1             8931473d5bdb        2 days ago          81.6 MB
  7. k8s.gcr.io/etcd                      3.3.10              2c4adeb21b4f        4 months ago        258 MB
  8. k8s.gcr.io/coredns                   1.3.1               367cdc8433a4        7 months ago        39.2 MB
  9. k8s.gcr.io/pause                     3.1                 da86e6ba6ca1        15 months ago       742 kB

3.kubeadm输出的主要信息，如下

  1. Your Kubernetes control-plane has initialized successfully!
  2.  
  3. To start using your cluster, you need to run the following as a regular user:
  4.  
  5.   mkdir -p $HOME/.kube
  6.   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  7.   sudo chown $(id -u):$(id -g) $HOME/.kube/config
  8.  
  9. You should now deploy a pod network to the cluster.
  10. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  11.   https://kubernetes.io/docs/concepts/cluster-administration/addons/
  12.  
  13. Then you can join any number of worker nodes by running the following on each as root:
  14.  
  15. kubeadm join 192.168.222.135:6443 --token srbxk3.x6xo6nhv3a4ng08m \
  16.     --discovery-token-ca-cert-hash sha256:b302232cbf1c5f3d418cea5553b641181d4bb384aadbce9b1d97b37cde477773

4.运行kubeadm配置

  1.   mkdir -p $HOME/.kube
  2.   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  3.   sudo chown $(id -u):$(id -g) $HOME/.kube/config

5.安装网络插件

kubectl apply -f "https://cloud.weave.works/k8s/net?k8s-version=$(kubectl version | base64 | tr -d '\n')"

6.确认是否安装完成，查看pod内是否有weave-net即可

  1. [root@master ~]# kubectl get pod --all-namespaces
  2. NAMESPACE     NAME                             READY   STATUS    RESTARTS   AGE
  3. kube-system   coredns-fb8b8dccf-glszh          1/1     Running   0          23m
  4. kube-system   coredns-fb8b8dccf-xcmtx          1/1     Running   0          23m
  5. kube-system   etcd-master                      1/1     Running   0          22m
  6. kube-system   kube-apiserver-master            1/1     Running   0          22m
  7. kube-system   kube-controller-manager-master   1/1     Running   0          22m
  8. kube-system   kube-proxy-z84wh                 1/1     Running   0          23m
  9. kube-system   kube-scheduler-master            1/1     Running   0          22m
  10. kube-system   weave-net-phwjz                  2/2     Running   0          95s

加入node

1.在两台node上分别运行主要信息内的命令，如下（这个不能复制，需要查看自己的kubeadm输出的信息）：

  1. kubeadm join 192.168.222.135:6443 --token srbxk3.x6xo6nhv3a4ng08m \
  2.     --discovery-token-ca-cert-hash sha256:b302232cbf1c5f3d418cea5553b641181d4bb384aadbce9b1d97b37cde477773

2.加入节点之后，发现node一直处于notready状态，好纠结

  1. [root@master bin]# kubectl get node
  2. NAME     STATUS     ROLES    AGE    VERSION
  3. master   Ready      master   167m   v1.14.1
  4. node1    NotReady   <none>   142m   v1.14.1
  5. node2    NotReady   <none>   142m   v1.14.1

3.查看pod节点，发现weave没启动

  1. [root@master bin]# kubectl get pods --all-namespaces
  2. NAMESPACE     NAME                             READY   STATUS              RESTARTS   AGE
  3. kube-system   coredns-fb8b8dccf-glszh          1/1     Running             1          168m
  4. kube-system   coredns-fb8b8dccf-xcmtx          1/1     Running             1          168m
  5. kube-system   etcd-master                      1/1     Running             1          167m
  6. kube-system   kube-apiserver-master            1/1     Running             1          167m
  7. kube-system   kube-controller-manager-master   1/1     Running             1          167m
  8. kube-system   kube-proxy-bq2rf                 0/1     ContainerCreating   0          143m
  9. kube-system   kube-proxy-m8f7z                 0/1     ContainerCreating   0          143m
  10. kube-system   kube-proxy-z84wh                 1/1     Running             1          168m
  11. kube-system   kube-scheduler-master            1/1     Running             1          167m
  12. kube-system   weave-net-8xmpx                  0/2     ContainerCreating   0          143m
  13. kube-system   weave-net-phwjz                  2/2     Running             4          147m
  14. kube-system   weave-net-xwqwm                  0/2     ContainerCreating   0          143m

4.使用describe pods发现报错，没有拉取镜像，可是本机上已经有k8s.gcr.io/pause:3.1 镜像了，在不懈的努力下，终于知道了，原来node节点上也需要该镜像

  1. kubectl describe pods --namespace=kube-system weave-net-8xmpx
  2.  
  3. Events:
  4.   Type     Reason                  Age                   From            Message
  5.   ----     ------                  ----                  ----            -------
  6.   Warning  FailedCreatePodSandBox  77m (x8 over 120m)    kubelet, node2  Failed create pod sandbox: rpc error: code = Unknown desc = failed pulling image "k8s.gcr.io/pause:3.1": Get https://k8s.gcr.io/v1/_ping: dial tcp 64.233.189.82:443: connect: connection refused
  7.   Warning  FailedCreatePodSandBox  32m (x9 over 91m)     kubelet, node2  Failed create pod sandbox: rpc error: code = Unknown desc = failed pulling image "k8s.gcr.io/pause:3.1": Get https://k8s.gcr.io/v1/_ping: dial tcp 64.233.188.82:443: connect: connection refused
  8.   Warning  FailedCreatePodSandBox  22m (x23 over 133m)   kubelet, node2  Failed create pod sandbox: rpc error: code = Unknown desc = failed pulling image "k8s.gcr.io/pause:3.1": Get https://k8s.gcr.io/v1/_ping: dial tcp 108.177.97.82:443: connect: connection refused
  9.   Warning  FailedCreatePodSandBox  17m (x56 over 125m)   kubelet, node2  Failed create pod sandbox: rpc error: code = Unknown desc = failed pulling image "k8s.gcr.io/pause:3.1": Get https://k8s.gcr.io/v1/_ping: dial tcp 74.125.203.82:443: connect: connection refused
  10.   Warning  FailedCreatePodSandBox  12m (x24 over 110m)   kubelet, node2  Failed create pod sandbox: rpc error: code = Unknown desc = failed pulling image "k8s.gcr.io/pause:3.1": Get https://k8s.gcr.io/v1/_ping: dial tcp 74.125.204.82:443: connect: connection refused
  11.   Warning  FailedCreatePodSandBox  2m31s (x20 over 96m)  kubelet, node2  Failed create pod sandbox: rpc error: code = Unknown desc = failed pulling image "k8s.gcr.io/pause:3.1": Get https://k8s.gcr.io/v1/_ping: dial tcp 108.177.125.82:443: connect: connection refused

5.node节点下载该镜像，分别运行以下命令，执行后发现还需要k8s.gcr.io/kube-proxy:v1.14.1 该镜像，那么一起处理吧（pull的镜像版本可以自己改，不改的话根据我的命令执行也可以）。

  1. docker pull mirrorgooglecontainers/pause:3.1
  2. docker tag docker.io/mirrorgooglecontainers/pause:3.1  k8s.gcr.io/pause:3.1
  3. docker pull mirrorgooglecontainers/kube-proxy-amd64:v1.11.3
  4. docker tag docker.io/mirrorgooglecontainers/kube-proxy-amd64:v1.11.3 k8s.gcr.io/kube-proxy:v1.14.1

6.大功告成
k8s,Kubernetes环境搭建，集群搭建，1个mster，2个node

创建一个pod测试

1.配置一个yml文件

  1. vim nginx.yml
  2. apiVersion: v1
  3. kind: Pod
  4. metadata:
  5.   name: nginx
  6.   labels:
  7.     app: web
  8. spec:
  9.   containers:
  10.   - name: nginx
  11.     image: nginx
  12.     ports:
  13.     - containerPort: 80

2.创建pod

kubectl create -f nginx.yml

3.查看IP并访问

  1. [root@master ~]# kubectl get pod -o wide
  2. NAME    READY   STATUS    RESTARTS   AGE     IP          NODE    NOMINATED NODE   READINESS GATES
  3. nginx   1/1     Running   0          4m11s   10.44.0.1   node1   <none>           <none>
  4.  
  5. [root@master ~]# curl 10.44.0.1
  6. <!DOCTYPE html>
  7. <html>
  8. <head>
  9. <title>Welcome to nginx!</title>
  10. <style>
  11.     body {
  12.         width: 35em;
  13.         margin: 0 auto;
  14.         font-family: Tahoma, Verdana, Arial, sans-serif;
  15.     }
  16. </style>
  17. </head>
  18. <body>
  19. <h1>Welcome to nginx!</h1>
  20. <p>If you see this page, the nginx web server is successfully installed and
  21. working. Further configuration is required.</p>
  22.  
  23. <p>For online documentation and support please refer to
  24. <a href="http://nginx.org/">nginx.org</a>.<br/>
  25. Commercial support is available at
  26. <a href="http://nginx.com/">nginx.com</a>.</p>
  27.  
  28. <p><em>Thank you for using nginx.</em></p>
  29. </body>
  30. </html>

感谢大家观看

转载于:https://blog.51cto.com/12708233/2377148