In parallel distributed computing system, lightly and overloaded nodes can cause load imbalancing and affect the total time needed to complete a task to increase. Besides that, since the distributed system shared by multiple users with their own computing task, load imbalance could bring impact on to other computing tasks. Lightly loaded nodes which are capable of compute more jobs, might finish their task faster and remain idle whilst heavily loaded nodes are still racing against the clock to complete their computing tasks. As a result, the utilisation of distributed system is not optimised. In order to solve this, load balancing algorithm is employed to balance the loads of each nodes. A load balancing algorithm can be further categorised as static or dynamic load balancing. A static load balancing algorithm formulates the job distribution decision before the execution of the program; during the compilation time.
展开▼
