K8S部署LocalPathProvisioner本地存储——筑梦之路

大多数生产环境会使用云存储或网络存储（如 EBS、NAS、Ceph）。但对于本地环境、轻量级集群，最快速、最低成本、性能最高的存储方式其实是：本地存储（Local PV）

项目地址：https://github.com/rancher/local-path-provisioner

apiVersion: v1 kind: Namespace metadata: name: local-path-storage --- apiVersion: v1 kind: ServiceAccount metadata: name: local-path-provisioner-service-account namespace: local-path-storage --- apiVersion: rbac.authorization.k8s.io/v1 kind: Role metadata: name: local-path-provisioner-role namespace: local-path-storage rules: - apiGroups: [""] resources: ["pods"] verbs: ["get", "list", "watch", "create", "patch", "update", "delete"] --- apiVersion: rbac.authorization.k8s.io/v1 kind: ClusterRole metadata: name: local-path-provisioner-role rules: - apiGroups: [""] resources: ["nodes", "persistentvolumeclaims", "configmaps", "pods", "pods/log"] verbs: ["get", "list", "watch"] - apiGroups: [""] resources: ["persistentvolumes"] verbs: ["get", "list", "watch", "create", "patch", "update", "delete"] - apiGroups: [""] resources: ["events"] verbs: ["create", "patch"] - apiGroups: ["storage.k8s.io"] resources: ["storageclasses"] verbs: ["get", "list", "watch"] --- apiVersion: rbac.authorization.k8s.io/v1 kind: RoleBinding metadata: name: local-path-provisioner-bind namespace: local-path-storage roleRef: apiGroup: rbac.authorization.k8s.io kind: Role name: local-path-provisioner-role subjects: - kind: ServiceAccount name: local-path-provisioner-service-account namespace: local-path-storage --- apiVersion: rbac.authorization.k8s.io/v1 kind: ClusterRoleBinding metadata: name: local-path-provisioner-bind roleRef: apiGroup: rbac.authorization.k8s.io kind: ClusterRole name: local-path-provisioner-role subjects: - kind: ServiceAccount name: local-path-provisioner-service-account namespace: local-path-storage --- apiVersion: apps/v1 kind: Deployment metadata: name: local-path-provisioner namespace: local-path-storage spec: replicas: 1 selector: matchLabels: app: local-path-provisioner template: metadata: labels: app: local-path-provisioner spec: serviceAccountName: local-path-provisioner-service-account containers: - name: local-path-provisioner image: rancher/local-path-provisioner:v0.0.32 imagePullPolicy: IfNotPresent command: - local-path-provisioner - --debug - start - --config - /etc/config/config.json volumeMounts: - name: config-volume mountPath: /etc/config/ env: - name: POD_NAMESPACE valueFrom: fieldRef: fieldPath: metadata.namespace - name: CONFIG_MOUNT_PATH value: /etc/config/ volumes: - name: config-volume configMap: name: local-path-config --- apiVersion: storage.k8s.io/v1 kind: StorageClass metadata: name: local-path provisioner: rancher.io/local-path volumeBindingMode: WaitForFirstConsumer reclaimPolicy: Retain --- kind: ConfigMap apiVersion: v1 metadata: name: local-path-config namespace: local-path-storage data: config.json: |- { "nodePathMap":[ { "node":"DEFAULT_PATH_FOR_NON_LISTED_NODES", "paths":["/opt/local-path-provisioner"] } ] } setup: |- #!/bin/sh set -eu mkdir -m 0777 -p "$VOL_DIR" teardown: |- #!/bin/sh set -eu rm -rf "$VOL_DIR" helperPod.yaml: |- apiVersion: v1 kind: Pod metadata: name: helper-pod spec: priorityClassName: system-node-critical tolerations: - key: node.kubernetes.io/disk-pressure operator: Exists effect: NoSchedule containers: - name: helper-pod image: busybox imagePullPolicy: IfNotPresent

默认StorageClass为local-path，所有节点都会使用/opt/local-path-provisioner作为存储路径，不过可以修改ConfigMap来自定义存储路径

可选：修改不同节点使用不同目录作为存储

{ "nodePathMap": [ { "node": "node1", "paths": ["/data/local1"] }, { "node": "node2", "paths": ["/data/local2"] } ] }

# 重启 kubectl -n local-path-storage rollout restart deploy/local-path-provisioner

测试

cat > nginx-local-pvc.yaml <<EOF apiVersion: v1 kind: PersistentVolumeClaim metadata: name: nginx-local-pvc spec: accessModes: - ReadWriteOnce storageClassName: local-path resources: requests: storage: 2Gi EOF cat > nginx-deploy.yml <<EOF apiVersion: apps/v1 kind: Deployment metadata: name: nginx-local spec: replicas: 1 selector: matchLabels: app: nginx-local template: metadata: labels: app: nginx-local spec: initContainers: - name: init-index image: busybox command: ["sh", "-c", "echo 'Hello from Local Path Provisioner!' > /data/index.html"] volumeMounts: - name: local-storage mountPath: /data containers: - name: nginx image: nginx:1.27 ports: - containerPort: 80 volumeMounts: - name: local-storage mountPath: /usr/share/nginx/html volumes: - name: local-storage persistentVolumeClaim: claimName: nginx-local-pvc EOF

做个记录