 |
A scalable architecture that effectively handles these two scenarios is illustrated in the figure. This architecture includes three main components: Load balancer, Management, and orchestrator (MANO) system and Auto-Scaling system with two auto-scaling algorithms. The load balancer can balance the requests between different virtual machines or pods that perform the same application in a virtual cluster. Management and orchestrator system used for management (VMs on Openstack or Pods on Kubernetes) collects resource usages or other attributes of all VMs, and Pods for each virtual cluster that is running on the Cloud. Auto-Scaling system with three modules in it includes Load balancer controller, Address collector, and Scaling management plugin. It can horizontally expand/shrink the number of VMs, the number of pods according to the workload of a virtual cluster over MANO where VMs, Pods belong and the new one can serve services. If the application running on the virtual cluster consumes most of the resources or is over a defined threshold, the auto-scaling system can create a new VM or new Pod that performs the same application and load balancer and then balances the requests among VMs or Pods in the same virtual cluster. |
IEEE/ICACT20230145 Slide.15
[Big Slide]