What's New in Kubernetes Storage
Link: https://youtu.be/1bqCDw999wg https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Kubernetes SIG Storage is responsible for ensuring storage is available for containers in a pod when the pod is scheduled on a node. There is the Container Storage Interface (CSI) for block and file storage that allows storage providers to write CSI drivers. There is also a COSI sub-project that is trying to add object storage support in Kubernetes. In this session, Xing will give an update on some of the features that SIG Storage is working on and discuss what might be coming in the future. ----- Xing Yang is a Tech Lead in the Cloud Native Storage team at VMware. She is a co-chair of the CNCF TAG Storage, a co-chair of the Kubernetes SIG Storage, a co-chair of the Kubernetes Data Protection WG, and a maintainer in Kubernetes CSI. Before joining VMware, Xing was the Lead Architect of OpenSDS while working for Futurewei. She also worked at Dell EMC for many years and has developed deep expertise in storage, data protection, disaster recovery, cloud, and virtualization technologies.
What's New in Kubernetes Storage
- 1. What’s New in Kubernetes Storage DoK Day Europe 2022 @ KubeCon Xing Yang, VMware
- 2. Agenda ● What we did in 1.23 ● What we did in 1.24 ● CSI Migration Update ● What we are working on in 1.25 ● Features in design/prototyping ● Cross SIG WG/projects
- 3. What we did in 1.23 ● GA ○ Skip volume ownership (FSGroup) ○ CSI FSGroup Policy ○ Generic ephemeral volumes ● Beta ○ Delegate FSGroup to CSI Driver instead of Kubelet ○ On-going effort: CSI migration ■ GCE (Beta, on-by-default) ■ Azure Disk (Beta, on-by-default) ■ AWS EBS (Beta, on-by-default)
- 4. What we did in 1.23 ● Alpha ○ Recovering from resize failures ○ Always honor reclaim policy ○ SIG-Apps: Auto remove PVCs created by statefulset ○ On-going effort: CSI migration ■ RBD ■ Portworx
- 5. 1.23 Deprecations ● Deprecation of Flexvolume
- 6. What we did in 1.24 ● GA ○ Volume expansion ■ Recovering from resize failures (Alpha in 1.23) ○ CSI Storage Capacity Tracking ○ CSI Migration ■ Azure Disk ■ OpenStack Cinder ● Beta ○ Volume populator ○ CSI Migration ■ Azure File (Beta, on-by-default) ● Alpha ○ CSI volume health (metrics; Alpha update) ○ Non-graceful Node Shutdown ○ Control volume mode conversion between source and target PVC
- 7. Deprecations and removals in 1.24 ● VolumeSnapshot v1beta1 API is removed in 1.24 (https://github.com/kubernetes/enhancements/issues/177). ● CSIStorageCapacity v1beta1 API is deprecated in 1.24 (https://github.com/kubernetes/enhancements/issues/1472). ● vSphere version < 7.0u2 is deprecated in 1.24 (related to CSI Migration)
- 8. CSI Migration Update Driver Alpha Beta (in-tree deprecated) Beta (on-by- default) GA Target "in-tree plugin" removal OpenStack Cinder 1.14 1.18 1.21 1.24 1.26 (Target) Azure Disk 1.15 1.19 1.23 1.24 1.26 (Target) Azure File 1.15 1.21 1.24 1.25 (Target) 1.27 (Target) AWS EBS 1.14 1.17 1.23 1.25 (Target) 1.27 (Target) GCE PD 1.14 1.17 1.23 1.25 (Target) 1.27 (Target) vSphere * 1.18 1.19 1.25 (Target) 1.26 (Target) 1.28 (Target) Ceph RBD 1.23 1.25 (Target) Portworx 1.23 1.25 (Target) * vSphere version < 7.0u2 is deprecated in 1.24
- 9. What we are working on in 1.25 ● Targeting GA ○ CSI ephemeral inline volumes ○ Delegate FSGroup to CSI Driver instead of Kubelet ○ Volume populator ○ Local ephemeral storage capacity isolation ○ On-going effort: CSI Migration ■ Azure File ■ GCE ● Targeting Beta ○ CSI volume health ○ Recovering from resize failures ○ Non-graceful Node Shutdown ○ On-going effort: CSI migration ■ vSphere (Beta, on-by-default) ■ RBD and Portworx (Beta, off-by-default)
- 10. What we are working on in 1.25 ● Targeting Alpha ○ Object Storage API (COSI) ○ SELinux relabeling with mount options ○ On-going effort: CSI Migration ■ CephFS
- 11. Features in Design/Prototyping ● Secret Deletion Protection (“Liens”) ● VolumeSnapshot namespace transfer ● VolumeGroup and VolumeGroupSnapshot
- 12. Cross SIG WG/projects ● Data Protection WG ○ Change block tracking (Design, prototype) ● SIG-Apps ○ Auto remove PVCs created by statefulset (Targeting Beta in 1.25) ● SIG-Node ○ ContainerNotifier (KEP in review) ● SIG-API-Machinery ○ in-use protection (Liens) (Design)
- 13. DoK Day North America 2021 @ KubeCon Thank you!