Yahoo! JAPAN currently has over 1000 Kubernetes clusters running on ZCP, a private CaaS. In these clusters, add-ons (groups of applications provided by platform providers) managed and provided by the CaaS side run separately from the user's applications. Add-ons are updated by CaaS, so users do not need to worry about their lifecycle.
When providing add-ons, since each cluster has a different version, a number of nodes, specifications, etc., of Kubernetes, it was necessary to consider the differences in an environment before deploying appropriate add-ons. Also, the system had to be able to handle the increase in clusters.
To deal with the above issues, ZCP has built a system that manages add-ons through decentralized management. This session introduces the mechanism and devices we made for the system.
