Efficient Load Balancing in Large-Scale Systems