Load balance
Course: Price of Anarchy
Professor: Michal Feldman
Student: Nave Frost
23/04/2014
Tight Bounds for Worst-Case Equilibria, Artur Czumaj and Berthold V¨ocking
Model
β’ π independent parallel links with speeds
π 1 , π 2 , β¦ , π π .
β’ π tasks with weights π€1 , π€2 , β¦ , π€π .
β’ Goal: allocate tasks to links to minimize the
maximum load of the links in the system.
Definitions
β’ Given a combination (π1 , π2 , β¦ , ππ ) β [π]π of
pure strategies, one for each task:
β’ The load of link π is: ππ =π π€π π.
π
π€π
ππ =ππ π π
π
β’ The cost for task π is:
β’ πππ‘ β
min
(π1 ,π2 ,β¦,ππ
)β[π]π
β’ Observation: πππ‘ β₯
( max (
πβ[π]
max π€π
π
max π π
π
.
π:ππ =π
π€π
π π
))
Mixed strategies
β’ Let ππ,π denote the probability that an task π
β π sends the entire weight π€π on link π.
β’ Let ππ denote the expected load on link j.
1
ππ β π πβ π π€πππ,π.
π
β’ Let ππ,π denote the expected cost for task π on
link j.
π€π‘ ππ‘,π
π€π
π€π
ππ,π β
+
= ππ + 1 β ππ,π
π π
π π
π π
π‘β π
Nash equilibrium
β’ Probabilities ππ,π define Nash equilibrium if
ππ,π > 0 implies ππ,π β€ ππ,π for every π β [π].
Price of anarchy
β’ ππ,π - probabilities that define Nash equilibrium.
Define πΆπ to be random variable indicating the
load of link π.
β’ πΆπ = π 1
π
β’ π½π,π
β’
π
π=1 π€π π½π,π
1, π€. π. ππ,π
=
0,
πππ π
π
E[πΆπ ] = πΈ
π=1 π€π π½π,π =
1
1
π
π
π€
πΈ[π½
]
=
π€π
π,π
π π π=1 π
π π π=1 π π,π
1
π π
= ππ
Price of anarchy (2)
β’ Let π denote the maximum expected load over
all links, that is:
π = max ππ = max πΈ[πΆπ ]
πβ[π]
πβ[π]
β’ Let the social cost πΆ denote the expected
maximum load over all links, that is:
πΆ = πΈ[ max πΆπ ]
πβ π
β’ Note that π β€ πΆ and possibly π βͺ πΆ.
Price of anarchy (3)
β’ The price of anarchy defined as :
πΆ
π
= max πππ‘
ππ,π
Claim 1
β’ Claim 1:
In Nash equilibrium, if ππ,π > 0 for certain task π β π and link π β π , then
for every link j β [m]
ππ + π€π π β₯ ππ
π
In particular, if ππ + 1 < ππ then π€π > π π .
β’ Proof:
ππ,π = ππ + 1 β ππ,π
ππ,π = ππ + 1 β
π€π
π€π
β€
π
+
π
π π
π π
π β₯ π
ππ,π π€
π
π π
Since ππ,π > 0, the
deο¬nition of Nash equilibria implies that ππ,π β€ ππ,π and
π€π
hence, ππ β€ ππ + .
π π
β’ The second part of the claim follows trivially from the ο¬rst one.
Identical links
β’ In the case of identical links all speeds are
identical, i.e., for all π1 , π2 β π
π π1 = π π2
Identical links (2)
β’ Theorem:
For π identical links the price of anarchy is
π
log π
log log π
.
β’ Proof:
Let us first re-scale the weights and speeds in the
problem and assume, without loss of generality,
that for all j β π : π π = 1 and πππ‘ = 1.
Identical links (3)
β’ Since πππ‘ = 1 and we observed that πππ‘
max π€π
β₯ π
, then βi β π : π€π β€ 1.
max π π
π
β’ Since πππ‘ = 1 there must exist a π such that
ππ β€ 1.
β’ Since ππ,π define Nash equilibrium it implies
that, according to claim 1:
π = max ππ β€ 2
πβ[π]
Identical links (4)
β’ We will estimate the load πΆπ of any link π β [π] by applying to πΆπ =
π
π=1 π€π π½π,π a standard concentration inequality due to Hoeffding
bound.
β’ Hoeffding bound: Let π1 , β¦ , ππ be independent random variables
with values in the interval [0, π§] for some π§ > 0, and let π‘π =
π
π=1 ππ ,
then for any π‘ it holds that Pr π β₯ π‘ β€
β’ Pr πΆπ β₯ π‘ = Pr
πππ π‘
π‘
β€
2π π‘
π‘
π
π=1 π€π π½π,π
β₯π‘ β€
For any π‘ > 0.
ππΈ
π
π=1 π€π π½π,π
π‘
ππΈ π
π‘
π‘
=
π§
ππΈ πΆπ
π‘
π‘
=
Identical links (5)
2π π‘
We saw that Pr πΆπ β₯ π‘ β€
For any π‘ > 0.
π‘
3 ln π
Therefore, if we pick π‘ =
we will get the following:
ln ln π
β
C = πΈ max πΆπ β€ t+
πβ π
β
π·π 2π π
β€ t+
π=π‘
Pr βπ β π : πΆπ β₯ π ·π
π=π‘
π
β
2βπ
β€ t+
π=π‘
3 ln π
β€π‘+1=
+1
ln ln π
Upper bound β Speed varies
β’ Lemma 1:
The maximum expected load π satisfies
c = πππ‘·π min
log π
π 1
, log
log log π
π π
where it is assumed that the speeds satisfy π 1 β₯ β― β₯ π π .
β’ Lemma 2:
The social cost πΆ satisfies
log π
C = πππ‘·π
+1
πππ‘· log π
log
π
Lemma 1 - Proof
β’ ππ,π define a Nash equilibrium.
β’ Without loss of generality, assume π 1 β₯ β―
β₯ π π .
β’ Scale weights of such that πππ‘ = 1.
β’ Will show:
c=O
log π
log log π
and c = O log
π 1
π π
c=O
log π
log log π
β Proof
Proof:
For π β₯ 1, define ππ to be the smallest index in
{0,1, β¦ , π} such that πππ +1 < π or, if no such index
exists, ππ = π.
Observe:
β’ for every π β₯ 1 with 0 < ππ , all links j < ππ have
load at least π.
β’ for every π β₯ 1 with ππ < π, link ππ + 1 has load
less than π.
c=O
log π
log log π
β Proof (2)
β’ Let π β = π β 1 .
β’ Will show that π1 β₯ π β !
β’ Hence, (recall that π1 β€ π)
πβ€Ξ
β1
π +1=
log π
log log π
1+π 1
β’ Gamma function: Ξ N + 1 = N! and Ξ β1 π is
the inverse.
Known:
log π
β1
Ξ
π =
(1 + π(1))
log log π
c=O
β’
log π
log log π
β Proof (3)
Claim: ππ β > 0 and hence π1 β₯ π β .
β’ Proof:
For the purpose of contradiction, assume:
π1 < π β β€ π β 1.
Let π denote the link with the maximum expected load.
ππ = π > π1 + 1
If there exist a task π with weight π€π β€ π 1 :
π β€ π + π€π β€ π + 1 < π
ππ,1 = π1 + 1 β ππ,1 π€
1
1
π
π 1
π 1
which contradicts to Claim 1.
Hence, there is no task π with weight π€π β€ π 1 and since:
πππ‘ β₯
max π€π
π
max π π
π
It leads to contradiction.
=
max π€π
π
π 1
>1
c=O
log π
log log π
β Proof (4)
β’ Claim: For π β₯ 1, ππ β₯ (π + 1)ππ+1 .
β’ Proof:
Let π be the set of tasks in the system that have
positive probability on at least one of the links
in {1, . . . , ππ+1 }.
Fix an optimal allocation strategy πππππ‘π. We
distinguish between two different ways of how
πππππ‘π might allocate the tasks in π to the links.
c=O
log π
log log π
β Proof (5)
β’ Case 1:
For the purpose of contradiction, assume πππππ‘π allocates at
least one of the tasks in π to a link π, π > ππ .
ππ denote the minimum weight of the tasks in π.
For all j β 1, . . . , ππ+1 :
ππ β₯ π + 1
πππ +1 < π
Therefore, according to claim 1 ππ > π ππ +1 .
But this implies that allocating a task from π to link π gives
ππ
ππ
cost at least
β₯
> 1.
π π
π ππ +1
This means πππ‘ > 1 and hence the contradiction.
c=O
log π
log log π
β Proof (6)
β’ Case 2:
Now let us assume πππππ‘π allocates all tasks in π to the links {1, β¦ , ππ }.
We will show that this implies ππ β₯ (π + 1)ππ+1 .
πΞ£T denote the sum of the weights of the tasks in π.
ππ+1
πΞ£T =
π€π β₯
πβπ
π€π
πβπ
ππ+1
ππ+1 π
ππ,π =
π=1
π€π ππ,π =
π=1 πβπ
ππ+1
π€π ππ,π =
π=1 π=1
ππ+1
ππ π π β₯ (π + 1)
π=1
On the other hand:
ππ
πΞ£T β€
π π
π=1
Hence:
ππ
ππ+1
π π β₯ (π + 1)
π=1
π π
π=1
Since the sequence of link speeds is non-increasing, this implies that ππ β₯ (π + 1)ππ+1 .
π π
π=1
c=O
log π
log log π
β Proof (7)
We combine both proven claims:
β’ Claim: ππ β > 0 and hence π1 β₯ π β .
β’ Claim: For π β₯ 1, ππ β₯ (π + 1)ππ+1 .
And get:
π1 β₯ π β ! ππ β β₯ π β !
As wanted.
Hence, π = O
log π
log log π
.
c = O log
β’ c = O log
π 1
π π
β Proof
π 1
π π
β’ Proof:
We will claim that the speeds of the links
π1 , π2 , β¦ increase in a geometric fashion.
c = O log
π 1
π π
β Proof (2)
β’ Claim For 1 β€ π β€ π β 3, π ππ+2 +1 β₯ 2π ππ +1 .
β’ Proof:
Fix an optimal strategy πππππ‘π.
For every link π β² β€ ππ+2 :
ππ β² β₯ π + 2 > 1 = πππ‘
Hence, There is task π and link π β {1, β¦ , ππ+2 } with ππ,π > 0
that πππππ‘π allocate to link in {ππ+2 + 1, β¦ , π}.
Note that:
π€π β€ π ππ+2 +1
Therefore, there exists a link j β {1, β¦ , ππ+2 } and a task π of
weight π€π β€ π ππ+2+1 with ππ,π > 0.
c = O log
π 1
π π
On the one hand:
ππ,π = ππ + 1 β ππ,π
On the other hand:
ππ,ππ +1 = πππ +1 + 1 β ππ,ππ +1
π€π
β Proof (3)
π€π
β₯ ππ β₯ π + 2
π π
β€ πππ +1 +
π€π
<π+
π€π
π ππ +1
π ππ +1
π ππ+1
Since we assume the system is in a Nash equilibrium, and ππ,π > 0 the
cost of task π on link π cannot be larger than the cost of task π on link ππ
π ππ+2 +1
π€π
π+2β€π+
β€π+
π ππ +1
π ππ+1
Clearly, this inequality implies that:
2π ππ+1 β€ π ππ+2 +1
Hence, the claim is shown.
c = O log
π 1
π π
β Proof (4)
The previous claim says that in a Nash
equilibrium the speeds increase geometrically
with the expected load.
This implies that:
π π β€ π π1+1 β€
Thus,
πβ2
β
2 2
· π ππβ1+1 β€
πβ2
β
2 2
π 1
c β€ 2 log
+ O(1)
π π
· π 1
Lemma 2 - Proof
We wish to show that πΆ satisfies:
log π
C = πππ‘·π
+1
πππ‘· log π
log
π
Our goal is to show, for every link j β [π], it is
unlikely that πΆπ deviates much from its
expectation.
For this purpose, we will use a Hoeffding bound.
Lemma 2 β Proof (2)
β’ Claim For every task π and link π with ππ,π
1
β 0, 4 , π€π β€ 12·π π ·πππ‘
β’ Proof:
We extend the definition of ππ to hold for
arbitrary πππ‘ in natural way: for π β₯ 1, we
define ππ as the smallest index in {1, β¦ , π} such
that πππ +1 < π·πππ‘, or, ππ = π if no such index
exists.
Lemma 2 β Proof (3)
Letβs look at link π β {ππ + 1, β¦ , ππβ1 } for some π β€ π β 3.
On the one hand:
π β₯ π β 1 ·πππ‘ + 3π€π
ππ,π = ππ + 1 β ππ,π π€
π
4π
π
On the other hand:
ππ,ππ+2 +1 = πππ+2 +1 + 1 β ππ,ππ+2 +1
π€π
β€ π + 2 ·πππ‘ + 2π
π
π€π
π ππ+2 +1
β€ πππ+2 +1 + π
π€π
ππ+2 +1
π
Since we assume the system is in a Nash equilibrium, and ππ,π > 0 the
cost of task π on link π cannot be larger than the cost of task π on link
ππ+2 + 1.
π β€ π + 2 ·πππ‘ + π€π . Which imply :
Hence, π β 1 ·πππ‘ + 3π€
4π
2π
π
π
π€π β€ 12·πππ‘ ·π π
Lemma 2 β Proof (4)
It remains to investigate the case π β€ ππ , where π = π β 3 .
On the one hand:
π€π
ππ,1 = π1 + 1 β ππ,1
β€ π·πππ‘ + πππ‘ = π + 1 ·πππ‘
π 1
On the other hand:
π€π
3π€π
3π€π
ππ,π = ππ + 1 β ππ,π
β₯ π·πππ‘ +
β₯ π β 4 ·πππ‘ +
π π
4π π
4π π
Since we assume the system is in a Nash equilibrium, and ππ,π > 0 the cost of
task π on link π cannot be larger than the cost of task π on link 1.
Hence, π β 4 ·πππ‘ +
This proves the claim.
3π€π
4π π
β€ π + 1 ·πππ‘. Which imply :
20
π€π β€
·πππ‘·π π < 12·πππ‘·π π
3
Lemma 2 β Proof (5)
Now let us focus on a single link π β [π].
We apply the claim in order to show that it is unlikely that πΆπ deviates
much from its expectation.
Denote:
ππ,1 - the set of tasks with ππ,π β 0, 14 .
ππ,2 - the set of tasks with ππ,π β 14, 1 .
πΆπ,1 - random variable that describe the cost on link π only counting
tasks in ππ,1 .
πΆπ,1 - random variable that describe the cost on link π only counting
tasks in ππ,2 .
Since only tasks with ππ,π > 0 can be allocated to link π:
πΆπ = πΆπ,1 + πΆπ,2
Lemma 2 β Proof (6)
Let us consider only the tasks in ππ,1 .
πΆπ,1 = π 1
π€π π½π,π
π
πβππ,1
β’ Remainder :
Hoeffding bound: Let π1 , β¦ , ππ be independent random variables with values
in the interval [0, π§] for some π§ > 0, and let π = ππ=1 ππ , then for any π‘ it
ππΈ π π‘ π§
holds that Pr π β₯ π‘ β€ (
)
π‘
According to the previous claim:
π β€ 12·πππ‘
max π€
π
πβππ,1 π
·
πΌ πππ‘
Pr πΆπ,1 β₯ πΌ·πππ‘ β€
For any πΌ > 1.
ππΈ πΆπ,1
πΌ·πππ‘
·
12 πππ‘
β€
ππ
πΌ·πππ‘
πΌ
12
Lemma 2 β Proof (7)
Let us consider only the tasks in ππ,2 .
πΆπ,2 = π 1
π€π π½π,π β€ π 1
π
πβππ,2
πΈ πΆπ,2 = πΈ
1
π π
πβππ,2
π€π π½π,π = π 1
π€π πΈ π½π,π > 4π 1
π
πβππ,2
π€π
π
πβππ,2
πβππ,2
Hence, we get:
πΆπ,2 < 4πΈ πΆπ,2 β€ 4π
Hence, for every πΌ > 1
ππ
Pr πΆπ β₯ 4π + πΌ·πππ‘ β€
πΌ·πππ‘
π€π
π
πΌ
12
Lemma 2 β Proof (8)
Denote β = max πΆπ.
πβ[π]
ππ
Pr β β₯ 4π + πΌ·πππ‘ β€ π
πΌ·πππ‘
Since of union bound.
πΌ
12
Lemma 2 β Proof (9)
Recall that πΆ is defined to be πΈ β .
Hence, for every π > 1, we can estimate πΆ as follows.
β
πΆ = πΈ β β€ 4π + Ξ»·πππ‘ + πππ‘·
Pr β β₯ 4π + π + π‘ ·πππ‘ ππ‘
0
β
β€ 4π + Ξ»·πππ‘ + πππ‘·π·
0
ππ
β€ 4π + Ξ»·πππ‘ + πππ‘·π·
π·πππ‘
Notice that for Ξ» β₯
21ππ
πππ‘
we have
β
ππ
0
π·πππ‘
π‘
12
π+π‘
ππ
π + π‘ ·πππ‘
π
β
12
ππ‘ =
·
0
ππ‘
·
π‘
ππ
π·πππ‘
12
ln
12
π πππ‘
ππ
12
ππ‘
β€ 4 and therefore we obtain:
ππ
πΆ β€ 4π + Ξ»·πππ‘ + 4·πππ‘·π·
π·πππ‘
π
12
Lemma 2 β Proof (10)
For Ξ» β₯
π
(2Ξ β1
πππ‘
(π·π
·
12 πππ‘
π
)) then:
ππ
π·πππ‘
To prove this inequality, let us set:
π0 =
π
1+Ξ
πππ‘
π
12
β€
β1
1
π
(π·π
12·πππ‘
π)
Observe that for any integer π β₯ 1
(π π)π β₯ π β 1 !
Therefore
π0 ·πππ‘
π·π
π0 ·πππ‘
π
β₯
π0 ·πππ‘
β 1 ! ·π β1
π
Since π0 ensures that:
π0 ·πππ‘
12·πππ‘
π
β 1 ! ·π β1 β₯ π
π
We can conclude that for any π β₯ π0 we have:
π
12·πππ‘
π0
π0 ·πππ‘
π
π
12
12
π·πππ‘
π0 ·πππ‘
π0 ·πππ‘
12·πππ‘
π
β₯
=
β₯ π
π·π
π·π
π·π
π
12·πππ‘
=π
Lemma 2 β Proof (11)
Therefore, if we set:
π = max
21ππ
π
1,
,
πππ‘ πππ‘
2Ξ
β1
π·π
·
12 πππ‘
π
=π 1
π
+
πππ‘
Upper bound - Proof
In Lemma 2 we saw
π
log π
πΆ = πππ‘·π 1 +
+
πππ‘ log πππ‘· log
π
π
If π β€ πππ‘ then
C = πππ‘·π
log π
+1
πππ‘· log π
log
π
If π > πππ‘ then by Lemma 1
π
log π
log π
=π
=π
πππ‘
log log π
log πππ‘· πlog π
Hence,
π
log π
log π
C = πππ‘·π 1 +
+
= πππ‘·π
+1
πππ‘ log πππ‘· log π
log πππ‘· log π
π
π
Lower bound
Letβs assume without loss of generality that π is an integer.
We consider πΎ + 1 groups of links πΈ0 , πΈ1 , β¦ , πΈπΎ .
And πΎ + 1 groups of tasks π0 , π1 , β¦ , ππΎ .
For all 0 β€ π β€ πΎ
πΎ!
πΈπ = · π
π!
ππ = π· πΈπ
For all π β πΈπ
For all π β ππ
π π = 2π
π€π = 2π
Will consider a pure strategy π in which for each π β πΈπ it assigns exactly π tasks from
ππ with probability 1 to be allocated to π.
Lower bound β (2)
In our construction πΎ can be chosen to be any positive integer that satisfies:
πΎ
πΈπ β€ π
π=0
Note that:
πΎ
πΎ
πΈπ =
π=0
π=0
π·πΎ!
= π·πΎ! ·
π!
πΎ
π=0
1
β€ π·πΎ! ·π
π!
Thus, our analysis can be carried over for all πΎ satisfying:
π·πΎ! ·π β€ π
And hence for all πΎ satisfying:
π
log π
πΎ β€ Ξ β1
β1=π©
π
log log π
Lower bound β (3)
β’ Claim Strategy π satisfies the following
properties:
1. The maximum load is c = πΎ.
2. The social optimum is 1 β€ πππ‘ β€ 2.
3. The system is in Nash equilibrium.
β’ Proof:
1. For all π β πΈπ the load πΆπ =
π ·2 π
π π
=
π·2π
2π
= π.
Lower bound β (4)
2. First we will observe that:
max π€π
2π
πππ‘ β₯
= π=1
max π π
2
π
π
Letβs consider a strategy in which for 0 β€ π < πΎ for each π β πΈπ it assigns a single task from ππ+1 with
probability 1 to be allocated to π.
Notice that:
πΎ!
πΈπ = · π
π!
πΎ!
πΎ!
ππ+1 = (π+1)· πΈπ+1 = (π+1)·
· π= · π
π+1 !
π!
For all π β πΈπ
π π = 2π
For all π β ππ+1
π€π = 2π+1
The cost of every link in the system is at most 2.
πππ‘ β€ 2
Lower bound β (5)
3. Let us take any task π that is allocated to link π β πΈπ , for π
β₯ 1.
Lets see that it is not beneficial for π to move to link π β πΈπ‘ .
π€π
ππ,π = ππ + 1 β ππ,π
= ππ = π
π π
π€π
2π
ππ,π = ππ + 1 β ππ,π
= ππ + π‘ = π‘ + 2πβπ‘
π π
2
Since π‘ + 2πβπ‘ β₯ π for any non-negative π‘ and π, none of the
tasks allocated to π has an incentive to migrate to another link.
Therefore, the system is in a Nash equilibrium.
Lower bound β Mixed strategy
We will slightly modify the pure strategy π to
obtain a mixed strategy πβ² for which:
log π
πΆ = π·π©
log(log(π) π)
For 0 β€ π < πΎ, πβ² will allocate tasks in the same
manner π did.
1
For all π β ππΎ and π β πΈπΎ , πβ² will set ππ,π = π.
Lower bound β Mixed strategy β (2)
β’ Claim Strategy πβ² satisfies the following properties:
1. The maximum load is c = πΎ.
2. The social optimum is 1 β€ πππ‘ β€ 2.
3. The system is in Nash equilibrium.
4. The social cost is πΆ = Ξ©
log π
log(log(π) πΎ)
β’ Proof:
1. The maximum load π is the same as for strategy πβ².
Lower bound β Mixed strategy β (3)
π. The value of opt is unaffected by the modification of the probabilities.
π. We have to show that for π β ππΎ it is not beneficial to move to link π β πΈπ‘ .
For π β πΈπΎ
π€π
1 2πΎ
1
ππ,π = ππ + 1 β ππ,π
=πΎ+ 1β
=
πΎ
+
1
β
π π
π 2πΎ
π
We can see that the costs for task π on link π slightly increased.
π€π
2πΎ
ππ,π = ππ + 1 β ππ,π
= ππ + π‘ = π‘ + 2πΎβπ‘
π π
2
The cost for task π on link π β πΈπ‘ remains the same as before.
1
Since π‘ + 2πΎβπ‘ β₯ πΎ + 1 β₯ πΎ + 1 β
for any non-negative π‘ and πΎ, none
π
of the tasks allocated to π has an incentive to migrate to another link.
Therefore, the system is in a Nash equilibrium.
Lower bound β Mixed strategy β (4)
π. To observe this property, we notice that the allocation of the tasks
in π β ππΎ to the links in πΈπΎ corresponds to the allocation problem of
throwing π·πΎ balls uniformly at random into π bins.
In expectation, it is known that the expected maximum occupancy in
this allocation problem is:
log π
π© πΎ+
log(log(π) πΎ)
Since πΎ = π©
log π
log log π
in our case. We get:
log π
π©
log(log(π) πΎ)
Since for π β ππΎ and j β πΈπΎ , π€π = π π , this bound on the maximum
occupancy directly implies a lower bound on the social cost.
© Copyright 2026 Paperzz