CORE DISCUSSION PAPER 9833 ON NASH EQUIVALENCE CLASSES OF GENERIC NORMAL FORM GAMES Fabrizio Germano1 May 1998 Abstract We introduce a procedure that uses basic topological characteristics of equilibrium correspondences of standard equilibrium concepts, to define broad equivalence classes of finite generic games in normal form. The proposed procedure is viewed as a potentially useful way of both organizing the underlying spaces of games as well as of comparing different equilibrium concepts with each other. The focus of the paper is mainly on equivalence classes induced by the Nash equilibrium concept. However, equivalence classes induced by the concepts of rationalizability, iterated dominance and correlated equilibrium are also considered. Keywords: non-cooperative games, classification and equivalence classes, geometry of equilibrium correspondences. JEL Classification: C70, C72 1 CORE, Université catholique de Louvain, Belgium. E-mail: [email protected] I would like to thank Jean-François Mertens, Joel Sobel and seminar participants at the University of Bielefeld for valuable comments and conversations. Financial support from CORE and the European Commission, Grant ERBFMBICT972857 is gratefully acknowledged. All errors are mine. This text presents research results of the Belgian program on Interuniversity Poles of Attraction initiated by the Belgian State, Prime Minister’s Office, Science Policy Programming. The scientific responsibility is assumed by the author. 1 Introduction The representation of a strategic situation by means of a normal form game is one of the most fundamental constructions of game theory. But, while much work has been done devising and studying different equilibrium concepts for normal form and extensive form games, not much has been done to systematically differentiate and classify the infinite number of normal form games that arise. (The reader is referred to Section 5 for a discussion of related literature and hence of some exceptions to this.) The present paper takes some standard equilbrium concepts like rationalizability, correlated and Nash equilibrium, and studies equivalence classes of generic normal form games that are implied by the singularities of the corresponding equilibrium correspondences. More precisely, these singularities are defined using very basic topological characteristics of the graphs of the equilibrium correspondences, so that they typically divide the space of games into a finite number of connected components of regular or nonsingular games. The equivalence classes are then defined such that all games within a component (as well as all games obtained from games in the component by applying the usual symmetry operations of relabeling players and their strategies) are considered to be equivalent and therefore identified with each other. This leads to classifications of normal form games that through the geometries of the equilibrium correspondences are naturally and essentially related to the corresponding equilibrium concepts. The classifications obtained yield a way of seeing which aspects of the normal form games the underlying equilibrium concepts distinguish and which aspects they ignore. At the same time, they provide natural organizations of the underlying spaces of games into welldefined equivalence classes, whereby, in order to keep the analysis as useful and essential as possible, the topological characteristics inducing the equivalence classes are chosen so as to obtain as broad classes as possible. To a large extent, this is done using transversality theory applied to the intersection of the graphs of the equilibrium correspondences with the underlying spaces of mixed strategies. Not only does all this provide a better understanding of the underlying equilibrium concepts and especially of the geometries of the corresponding equilibrium correspondences, but it also provides a particularly transparent way of comparing equilibrium concepts with each other. In fact, the (topological) procedure we propose to use to classify normal form games appears to extend to many other equilibrium concepts beyond the three studied in this paper. At the same time, the present approach to analyzing normal form games also forces one to think about what the fundamental characteristics de1 scribing a strategic situation should be and why. Similar considerations have received some attention recently for example in the experimental literature (Crawford (1997), Roth and Erev (1995, 1997)) and in the literature on games with incomplete information (Carlsson and van Damme (1993), Morris, Rob, and Shin (1995)). The paper is organized as follows. Section 2 introduces preliminary notation and definitions, in Section 3 the Nash equivalence classes are defined, and Section 4 contains some general propositions for two player games as well as classifications of small two person games using the Nash equilibrium, rationalizability, iterated dominance, and correlated equilibrium concepts. Finally, Section 5 discusses related literature, and Section 6 concludes. The paper is to be viewed only as a very first step towards understanding the rather complex structures of the resulting sets of equivalence classes, with particular attention to two person games. 2 Preliminary Notions Let I = {1, . . . , n} denote the set of players, let Si denote player i’s strategy space, Si the set of probability measures on Si , and let S = ×i∈I Si , S = ×i∈I Si , S−i = ×j∈I\{i} Sj , and S−i = ×j∈I\{i} Sj . Set Ki = #Si , K = Σi∈I Ki , κ = Πi∈I Ki , Li = {1, . . . , Ki }, and let fi : S → IR denote player i’s payoff function and Fi : S → IR, σ 7→ Σs∈S ν(s, σ)fi (s), player i’s expected payoff function, where ν : S × S → [0, 1], (s, σ) 7→ ν(s, σ), gives the probability of the strategy profile s under the mixed strategy profile σ. A game in normal form γ is defined as a pair (S, f ) or, alternatively, as a pair (S, F ) and we say it is finite if n and each Ki , i ∈ I, are finite. In what follows, we consider only finite normal form games and fix both the set of players I as well as the space of strategy profiles S, so that we can identify a game γ with a point in the Euclidean space IRκn and, accordingly, the space of games with the whole Euclidean space IRκn . We also denote by γ i ∈ IRn the payoff array of player i. Let γ ∈ IRκn be a finite normal form game, and let σ −i ∈ S−i be a strategy profile of all players except i, then the set of best replies of player i to σ −i is defined by: BRi (γ, σ −i ) = {σ i ∈ Si : Fi (σ i , σ −i ) ≥ Fi (sik , σ −i ), ∀k ∈ Li }, and the best reply correspondence of player i is defined by: BRi : IRκn × S−i → Si , (γ, σ−i ) 7→ BRi (γ, σ−i ). 2 We denote by βi ⊂ IRκn × S the graph of player i’s best reply correspondence. The set of Nash equilibria of γ is defined by: N E(γ) = {σ ∈ S : F (σ) ≥ F (sik , σ −i ), ∀k ∈ Li , ∀i ∈ I}, where a point in the set N E(γ) ⊂ S is a Nash equilibrium of the game γ, and the Nash equilibrium correspondence is defined by: N E : IRκn → S, γ 7→ N E(γ). It maps to each game γ ∈ IRκn the corresponding set of Nash equilibria N E(γ). Let ηN E ⊂ IRκn × S denote the graph of the Nash equilibrium correspondence. Kohlberg and Mertens (1986), Theorem 1, p. 1021, show that ηN E is a manifold of dimension κn homeomorphic to the underlying space of games IRκn .1 We will need the following stronger result. Lemma 1 For any nonempty subset of players J ⊂ I, the intersection of the graphs of the best reply correspondences of the players in J is homeomorphic to the product of the underlying space of games with the space of mixed strategy profiles of the players not in J, i.e., ∩j∈J βj ≈ IRκn × (×i∈I\J Si ). P roof . The proof is very similar to the proof in Kohlberg and Mertens (1986), p. 1021-1022. Let J = {1, . . . , l}, JC = {l + 1, . . . , n} and consider the reparameterization of the payoffs of the players in J, i = Ais,t + ais , s ∈ Si , t ∈ S−i , i ∈ J, γs,t where Σt∈S−i Ais,t = 0, for all s ∈ Si , i ∈ J. Next, consider the following maps: f : β1 ∩ · · · ∩ βl → IRκn × Sl+1 × · · · × Sn , i j Πj6=i σtjj ))i∈J ((γ i )i∈I , (σ i )i∈I ) 7→ (((Ais,t + (σsi + Σt∈S−i γs,t s,t , (γ )j∈JC , (σj )j∈JC ) and h : IRκn × Sl+1 × · · · × Sn → β1 ∩ · · · ∩ βl , j i j ((γ i )i∈I , (σ j )j∈JC ) 7→ ((Ais,t +gsi ((γ j )j∈J , (σ j )j∈JC ))i∈J s,t , (γ )j∈JC , (πSi (a ))i∈J , (σ )j∈JC ), 1 We say E ⊂ IRp is a manifold of dimension n if every point in E has a neighborhood homeomorphic to the Euclidean space IRn . See for example Greenberg and Harper (1981), Ch. 6, p. 28. 3 where, for i ∈ J, πSi : IRKi → Si is the projection from IRKi onto the simplex Si , and g i is defined by: g i : IRκ × Sl+1 × · · · × Sn → IRKi , ((γ i )i∈J , (σ j )j∈JC ) 7→ ((ais − πSi (ais ) − Σt∈S−i Ais,t Πj∈JC σtjj Πj∈J\{i} πSj (ajtj ))s ). The maps f and h are homeomorphisms between IRκl × Sl+1 × · · · × Sn and β1 ∩· · ·∩βl . While it is easy to see that both are continuous, it is more tedious, although straightforward, to see that they are inverses of each other. 2 The notion of Nash equivalence that will be given in the next section relies heavily on a certain notion of regularity of a given game. The notion of regularity is defined in terms of a transverse intersection of certain manifolds. The next definition introduces the notion of a (topologically) transverse intersection. Definition 1 Let E ⊂ IRp be a manifold of dimension n and let S, T ⊂ E be submanifolds of dimensions s and t, where s + t ≥ n. We say S and T intersect (topologically) transversally at a point x ∈ E if there is a coordinate neighborhood U ⊂ E of x and a homeomorphism ζ : (U, U ∩ S, U ∩ ≈ (S ∩ T ), U ∩ T ) → (IRn , IRs × {0}, {0} × IRs+t−n × {0}, {0} × IRt ) that maps U to IRn , U ∩ S to IRs × {0}, U ∩ (S ∩ T ) to {0} × IRs+t−n × {0}, and U ∩ T to {0} × IRt . We say S and T are (topologically) transverse if they intersect transversally at each point x ∈ S ∩ T .2 Here are some standard definitions that will be useful later in the text. Definition 2 Let (γ, σ) ∈ ηN E be a point on the graph of the Nash equilibrium correspondence, we say N E is locally continuous at (γ, σ) if there are neighborhoods Uγ ⊂ IRκn of γ and Uσ ⊂ S of σ such that the correspondence N E restricted to mapping from Uγ to Uσ is continuous at γ. We say σ is an isolated Nash equilibrium of the game γ if there exists a neighborhood Uσ ⊂ S of σ such that (γ, σ) = ({γ} × Uσ ) ∩ ηN E . 2 See for example Greenberg and Harper (1981), Ch. 31, p. 290-291. Notice that if E is with boundary, then the coordinate neighborhoods U may also have a boundary, in which case, if neither U ∩ S nor U ∩ T are contained in the boundary of U , then the homeorphism ≈ takes the form ζ : (U, U ∩ S, U ∩ (S ∩ T ), U ∩ T ) → (IH n , IH s × {0}, {0} × IH s+t−n × {0}, {0} × t n n IH ), where IH ⊂ IR denotes the halfspace {x ∈ IRn |xn ≥ 0}. If, say, U ∩ S is contained in the boundary of U , then IH s × {0} and {0} × IH s+t−n × {0} are replaced by IRs × {0} and {0} × IRs+t−n × {0}. 4 We say σ is an essential Nash equilibrium of the game γ if for any arbitrarily small neighborhood Uσ of σ there exists a neighborhood Uγ of γ such that ({γ 0 } × Uσ ) ∩ ηN E is nonempty, for all γ 0 ∈ Uγ . Finally, we say σ is a locally unique Nash equilibrium of the game γ, if there exists a neighborhood U ⊂ ηN E of (γ, σ) such that the projection map π : IRκn × S → IRκn , (γ, σ) 7→ γ, restricted to U is a homeomorphism onto π(U ). The following relation follows immediately from either Kohlberg and Mertens (1986), Theorem 1, p. 1021, or from Lemma 1 above, for J = I since ηN E = ∩i∈I βi . Lemma 2 Let (γ, σ) ∈ ηN E be a point on the graph of the Nash equilibrium correspondence, then N E is locally continuous at (γ, σ) if and only if σ is an isolated and essential Nash equilibrium of γ. In Section 4 we will consider further relations between the concepts defined in this and the following section. In the next section, we introduce the notion of Nash equivalence for generic games. 3 Nash Equivalence Classes Generally speaking, the procedure we use to classify normal form games consists of two steps. In the first step, we use the equilibrium correspondence of the underlying equilibrium concept to decompose the space of games into typically finitely many connected components. This is done via basic topological characteristics of the equilibrium correspondences such as regularity in the case of Nash equivalence, or the dimension of the set of correlated equilibria in the case of correlated equivalence. Since, by our very definition of the equivalence classes, all games within a given component are considered to be equivalent, this first step allows to reduce the infinite number of games to a typically finite number. In the second step, the connected components obtained in the first step are further identified by identifying games that are obtained one from the other by reordering either the strategies of the players or by reordering the players themselves. This does not make use of any equilibrium concept but, rather, of fundamental assumptions on the behavior of the players by which they all act in the same way, selecting strategies that maximize payoffs regardless of the labels attached to them and regardless of the labels attached to themselves as players in the game. This second step generally substantially reduces the number of different connected components to be distinguished. After all 5 identifications are made, i.e., after the connected components of the first step are identified according to the identifications of the second step, we associate to each of the different sets of connected components an equivalence class of games. Two games that belong to the same equivalence class are then said to be equivalent. The classification, finally, is determined by the resulting set of classes of equivalent games. Now we formally describe the procedure for the case of Nash equilibrium. Before defining the notion of Nash equivalence, we first introduce the notions of a regular Nash equilibrium and of a Nash regular game. Definition 3 Let γ ∈ IRκn be a finite game in normal form, we say a Nash equilibrium σ ∈ N E(γ) is (topologically) regular if ηN E intersects {γ} × S transversally at (γ, σ) ∈ ηN E . Furthermore, a game in normal form is said to be Nash regular if all its Nash equilibria are (topologically) regular. It is said to be Nash singular if it is not Nash regular. The notion of (topologically) regular Nash equilibrium is related although, generally speaking, weaker than the corresponding notion defined for example in Harsanyi (1973), p. 241, and van Damme (1991), p. 38. More precisely, by requiring certain full rank conditions on certain Jacobian matrices, Harsanyi and van Damme’s definition requires that the intersection of ηN E with {γ 0 }×S be transverse for all γ 0 in an arbitarily small neighborhood of γ, thus implying local uniqueness of the given regular equilibrium. In contrast, our definition requires the intersection of ηN E with the vertical space {γ 0 }×S to be transverse only at γ 0 = γ, thereby allowing isolated equilibria to be regular even if the correspondence N E is locally not a function. Harsanyi (1973), Theorem 3, p. 249, also shows that the space of games with only regular Nash equilibria in his sense is dense in the space of games, and Blume and Zame (1994), Theorem 3, p. 792 and p. 785, strengthen this result and show that the class of games with discontinuous Nash equilibrium correspondence is contained in a closed, lower dimensional, semi-algebraic subset of the space of games, which divides the space of games into a finite number of connected components. (See also Schanuel, Simon, and Zame (1991), p. 21.) We will see in the next section how the Nash singular two person games coincide with games with discontinuous Nash equilibrium correspondence, which shows that the number of components of Nash regular games will also be finite. More generally, given the semialgebraic nature of all equilibrium correspondences considered in this paper, we can use the Generic Local Triviality Theorem (see for example Blume and Zame (1994), p. 785, or Schanuel et al. (1991), p. 20) to show that the number of maximal connected components of 6 equivalent games - in any of the senses to be defined below - will always be finite. The second part of the definition of Nash equivalence can be formalized by means of certain maps, which we call symmetry operations, following Nash (1951), p. 288-289, that identify games through relabeling of the players’ strategies and/or of the players themselves.3 More precisely, let Pa be the set of all permutations pa : I → I satisfying Kpa (i) = Ki , i ∈ I, let Ps be the set of all permutations ps = (pis : Si → Si )i∈I , and let: p (i) Ψa = {ψa : IRκn → IRκn |ψa (γ) = (γk a−1 pa (1) ,..,k p−1 a (n) )i∈I , pa ∈ Pa , γ ∈ IRκn }, Ψs = {ψs : IRκn → IRκn |ψs (γ) = (γpi 1s (k1 ),..,pns (kn ) )i∈I , ps ∈ Ps , γ ∈ IRκn }. We say a map ψ : IRκn → IRκn is a symmetry operation within the class of n-person K1 × · · · × Kn games, if ψ = ψa ψs for some ψa ∈ Ψa , ψs ∈ Ψs , and denote by Ψ the set of all such symmetry operations. Notice that this space depends on the number of players and the cardinality of the strategy spaces, i.e., on K1 , . . . , Kn , which, to save notation, we often leave out. The maps pa ∈ Pa , ps ∈ Ps correspond respectively to relabeling of the players and of the players’ strategies. The maps ψa ∈ Ψa , ψs ∈ Ψs are the maps induced on the space of games by corresponding maps pa and ps . Lemma 3 The space Ψ with the composition operation forms a subgroup of the group of linear maps A : IRκn → IRκn with determinant + or −1. P roof . Clearly, the space of linear maps A : IRκn → IRκn with determinant + or −1 forms a group with the usual composition of matrices. We need to show, that the elements of Ψ are indeed matrices with determinant + or −1, and that they form a subgroup of the space of all such linear maps. (i) Since the maps pa , ps are permutations, the induced maps ψa , ψs are also permutations of the entries of the given game γ. Hence they are linear maps representable by (κn) × (κn) matrices that moreover have, for every row and column, exactly one entry equal to 1 and all other entries equal to 0. This readily implies that they are invertible and have determinant + or −1. Clearly, all these properties carry over when composing ψa , ψs . (ii) To see that Ψ contains the unit element, notice that taking pa , ps to be the identities, one obtains ψa , ψs , and hence also ψ = ψa ψs to be the identity matrix. To see that ϕψ ∈ Ψ whenever ϕ, ψ ∈ Ψ, notice that, for every 3 For a thorough treatment of such symmetries within a more general class of games, the reader is referred to Mertens (1987) and the notions of ordinality defined there. 7 ψa ∈ Ψa , ψs ∈ Ψs , there exists ψ̃s ∈ Ψs such that ψs ψa = ψa ψ̃s . (Take ψ̃s to p−1 (i) be the map induced by p̃s = (ps a )i∈I .) Then we have: ϕψ = (ϕa ϕs )(ψa ψs ) = ϕa (ϕs ψa )ψa = ϕa (ψa ϕ̃s )ψa = (ϕa ψa )(ϕ̃s ψa ) = ψ̃a ψ̃s ∈ Ψ, for some ψ̃a ∈ Ψa , ψ̃s ∈ Ψs . Finally, to see that each element ψ ∈ Ψ has an inverse element ψ −1 ∈ Ψ, notice that, if ψ = ψa ψs , then ψ −1 = ψs−1 ψa−1 is such an inverse that is contained in Ψ since ψs−1 ψa−1 = ψa−1 ψ̃s and ψa−1 ∈ Ψa , ψ̃s ∈ Ψs . 2 Next we introduce the notion of Nash equivalence. Definition 4 Let IRκn be the space of K1 ×· · ·×Kn games in normal form with n players, we say the games γ0 , γ1 ∈ IRκn are Nash equivalent, which we denote by γ0 ∼N E γ1 , if there exists a symmetry operation ψ ∈ Ψ(K1 , . . . , Kn ), and a continuous path υ : [0, 1] → IRκn , with υ(0) = γ0 and υ(1) = ψ(γ1 ), such that, for all γ ∈ υ([0, 1]), γ is Nash regular. Notice that since we require all games along the path υ to be Nash regular, including the games at the endpoints, γ0 , γ1 , we in fact define Nash equivalence only for Nash regular games. The following shows that this indeed defines an equivalence relation. Lemma 4 The relation ∼N E defines an equivalence relation on the space of Nash regular games in IRκn . P roof . We need to show that ∼N E is reflexive, symmetric, and transitive. (i) ∼N E reflexive: take the identity map in Ψ and the constant path, υ : [0, 1] → IRκn , t 7→ γ, and it follows that γ ∼N E γ for any Nash regular game γ ∈ IRκn . (ii) ∼N E symmetric. Let γ0 , γ1 ∈ IRκn and suppose γ0 ∼ γ1 , then there exist ψ ∈ Ψ, υ : [0, 1] → IRκn , with υ(0) = γ0 and υ(1) = ψ(γ1 ), such that, for all γ ∈ υ([0, 1]), γ is Nash regular. Let ψ̃ = ψ −1 ∈ Ψ be the inverse of ψ, and consider the path υ̃ : [0, 1] → IRκn , t 7→ ψ̃(υ(1 − t)), then υ̃(0) = ψ̃(υ(1)) = ψ −1 (ψ(γ1 ) = γ1 and υ̃(1) = ψ̃(υ(0)) = ψ̃(γ0 ). Moreover, since all games in υ([0, 1]) are Nash regular so must be all games in υ̃([0, 1]) since applying a symmetry operation to a game certainly does not affect whether the game is Nash regular or not. (iii) ∼N E transitive. let γi ∈ IRκn , i = 0, 1, 2 and suppose γ0 ∼N E γ1 and γ1 ∼N E γ2 , then there exist ψi ∈ Ψ, υi : [0, 1] → IRκn , with υi (0) = γi , 8 υi (1) = ψi (γi+1 ), i = 0, 1, such that, γ is Nash regular, for all γ ∈ υi ([0, 1]), i = 0, 1. Let ψ = ψ0 ψ1 ∈ Ψ, and consider the path: ( υ : [0, 1] → IR , t 7→ κn υ0 (2t), 0 ≤ t ≤ 1/2 . ψ0 (υ1 (2t − 1), 1/2 ≤ t ≤ 1 Then we have, υ(0) = υ0 (0) = γ0 , υ(1/2) = υ0 (1) = ψ0 (γ1 ) = ψ0 (υ1 (0)) and υ(1) = ψ0 (υ1 (1)) = ψ0 ψ1 (γ2 ) = ψ(γ2 ), where again all games along the path are Nash regular. This implies γ0 ∼N E γ2 and completes the proof. 2 The following, stronger notion of regularity is useful when computing Nash equivalence classes. Definition 5 Let βi ⊂ IRκn × S be the graph of player i’s best reply correspondence, i ∈ I, let γ ∈ IRκn be a finite game in normal form, we say the game γ is regular if, for all J ⊂ I, JC ⊂ I \ J, and Ti ⊂ Si for i ∈ JC , (∩j∈J βj ) intersects {γ} × (∩i∈JC ,ti ∈Ti {σ ∈ S|σtii = 0}) transversally. We say it is singular if it is not regular. Roughly, a game γ is regular if the graphs of the best reply correspondences of all players as well as all their intersections are transverse or in general position with respect to all the possible faces and intersections of faces of the space of mixed strategies S. This is a particularly strong notion of regularity, which, in Section 4, will be seen to have a particularly nice characterization for two player games. The following lemma gives an idea of some of the implications of requiring tranversal intersections of graphs of best reply correspondences with the corresponding spaces of mixed strategies. First, recall that a strategy sik ∈ Si of player i is said to be redundant if there exists a convex combination of the other strategies of player i that leads to precisely the same payoffs for player i at all possible strategy profiles s−i ∈ S−i of the other players. A strategy sik ∈ Si of player i is said to be weakly dominated if there exists a convex combination of the other strategies of player i that leads to payoffs for player i at least as large as all payoffs of strategy sik at all possible strategy profiles s−i ∈ S−i of the other players and strictly larger for at least one strategy profile s−i ∈ S−i of the other players, and it is said to be strictly dominated if there exists a convex combination of the other strategies of player i that leads to payoffs for player i that are strictly larger for all strategy profiles s−i ∈ S−i of the other players. The following is a characterization of transversal intersections of βi with {γ} × S. 9 Lemma 5 Let γ ∈ IRκn be a finite game in normal form. Then, for i ∈ I, βi is transverse to {γ} × S if and only if, at γ, player i has neither redundant nor weakly dominated strategies that are not strictly dominated. P roof . (⇒): Suppose sik ∈ Si is redundant or weakly but not strictly dominated, then there exists some mixed strategy profile σ −i of the other players that makes player i indifferent between strategy k and some other mixed strategy σ i ∈ Si that is either payoff equivalent to or weakly dominates sik . This implies that sik is a best reply to σ −i . Consider the perturbation of γ that decreases the payoffs of player i at all entries of strategy k against the strategy profiles in the support of σ −i by some arbitrarily small amount. Then it is clear that, at any such arbitrarily close game, sik is not a best response to neither σ −i nor to any mixed strategy profile close to σ −i . But this implies that βi cannot be transverse to {γ} × S at (γ, (sik , σ −i )). (⇐): Suppose that, at γ, player i has neither redundant nor weakly dominated strategies that are not strictly dominated. Then for each strategy of player i there exists at least one mixed strategy profile σ −i ∈ S−i of the other agents such that player i’s payoff of playing sik against σ −i is strictly greater than that of any other strategy in Si . In view of Lemma 1 and since the set of best replies to any mixed strategy profile σ −i ∈ S−i of the other agents is always a face of the simplex {γ} × Si × {σ −i }, it suffices to show that, for each point (γ, σ) ∈ βi ∩ ({γ} × S), there exists, for each γ 0 arbitrarily close to γ, a point (γ 0 , σ 0 ) ∈ βi ∩({γ 0 }×S) arbitrarily close to (γ, σ). In particular, this will show that at any γ 0 arbitrarily close to γ there are strategy profiles of the other 0 players σ −i that are arbitrarily close to σ −i such that player i’s set of best 0 replies to σ −i at γ 0 is a simplex of the same dimension as the one against σ −i at γ. Pick (γ, σ) ∈ βi ∩ ({γ} × S), and let γ 0 be any game arbitrarily close to γ. Since i has neither redundant nor weakly dominated strategies that are not strictly dominated, there exists, for each sik in the support of σ i at least one mixed strategy τ −i (k) ∈ S−i such that F (sik , τ −i (k)) > F (sil , τ −i (k)), l 6= k. Moreover, each of the vectors τ −i (k) can be chosen from an open subset of S−i therefore providing sufficiently many directions in which to adjust (if neces0 sary) the other agents’ mixed strategy from σ −i to σ −i so as to make player i indifferent between all strategies in the support of σ i against the new strategy 0 profile σ −i at the perturbed game γ 0 . This then shows that the set of pure 0 best responses against σ −i at γ 0 coincides with the set of pure best responses to σ −i at γ. In particular, there exists, for each γ 0 arbitrarily close to γ, a point (γ 0 , σ 0 ) ∈ βi ∩ ({γ 0 } × S) arbitrarily close to (γ, σ), which concludes the proof of the lemma. 2 10 Corollary 1 Let γ ∈ IRκn be a finite game in normal form, then, if γ is regular, it is also Nash regular, and there are neither redundant nor weakly dominated strategies that are not strictly dominated. P roof . This follows immediately from the definitions and Lemma 5 above, after noticing that ηN E = ∩i∈I βi . 2 This implies that the set of singular games divides the space of games into at least as many components as does the set of Nash singular games. Further characterizations of the notions of regularity and Nash regularity will be given in the next section. 4 Two Person Games In this section we consider two person normal form games. To save on notation, we write m = K1 , n = K2 , and κ = mn. Occasionally, we will also describe two person games by means of two m × n matrices A and B that denote the payoffs respectively of players 1 and 2. Before considering the general case, we first consider some simple examples. 4.1 2 × 2 Games The space of 2 × 2 two person games which we identify with IR8 is divided by the singular 2 × 2 games into 16 connected components of regular games. By Corollary 1 the set of Nash singular games is contained in the set of singular games, so that all games within any given one of the 16 connected components are Nash equivalent. Applying the symmetry operations of relabeling the players’ strategies further identifies some of the 16 components and leads to 5 classes of Nash regular games, where all games within a given class are Nash equivalent. The 5 classes can be unambiguously represented by the following games: Ã γ1 = (1, 0) (0, 1) (0, 1) (1, 0) Ã γ20 = ! Ã , γ2 = (1, 1) (1, 0) (0, 1) (0, 0) (1, 1) (1, 0) (0, 0) (0, 1) ! Ã , γ200 = ! Ã , γ3 = (1, 1) (0, 0) (0, 0) (1, 1) (1, 1) (0, 0) (0, 1) (1, 0) ! , ! . Applying the symmetry operation of relabeling the players allows to further identify γ20 and γ200 . Moreover, it is easy to see that the games γ2 , γ20 , γ200 can all be connected by paths of Nash regular games, so that they are in fact all Nash 11 equivalent, i.e., [γ2 ] = [γ20 ] = [γ200 ], where [γ] denotes the Nash equivalence class containing the game γ. This shows that the space of Nash regular 2 × 2 games can be decomposed into the three Nash equivalence classes [γ1 ], [γ2 ], and [γ3 ]. As one may expect, these are precisely the Nash regular games with only one mixed strategy Nash equilibrium, [γ1 ], with only one pure strategy equilibrium, [γ2 ], and with one mixed and two pure strategy equilibria, [γ3 ]. Examples of games in the different classes are the matching pennies games for [γ1 ], the prisonners’ dilemma games for [γ2 ], and games like battle of the sexes, pure coordination games, and chicken for [γ3 ]. 4.2 2 × 3 Games Similarly, it can be shown that the space of 2 × 3 two person games can be decomposed into five Nash equivalence classes of Nash regular games of which three are essentially represented by γ1 , γ2 , and γ3 , (after adding a strictly dominated strategy for player 2), and that the other two classes, which are not present among the 2 × 2 games, have representatives: Ã γ4 = (1, 3) (0, 2) (1, 0) (0, 0) (1, 2) (0, 3) ! Ã , γ5 = (1, 3) (1, 2) (0, 0) (0, 0) (0, 2) (1, 3) ! . These are representatives of Nash regular games with one pure strategy and two mixed strategy equilibria, [γ4 ], and with one mixed strategy and two pure strategy equilibria, [γ5 ], where all pure strategy profiles are in the support of at least one of the Nash equilibria. Notice that within the 2×2 and the 2×3 Nash regular games, knowing the equilibrium distributions of the Nash equilibria is sufficient to place the game unambiguously within its Nash equivalence class. This already fails with the 3 × 3 games. 4.3 3 × 3 Games It can also be shown, and this is quite tedious, that the space of 3 × 3 two person games, which we identify with IR18 , can be decomposed into 32 Nash equivalence classes of Nash regular games of which five are essentially represented by γ1 , . . . , γ5 , (again, after adding a strictly dominated strategy for player 1), and that the other 27 can be found in the appendix.4 4 To give an idea of the difficulties that arise in performing the complete classification already for the 3 × 3 games, notice that while in the 2 × 2 case the singular games divided the space of games into 16 connected components of regular games, in the 3 × 3 case the corresponding number of connected components is well over 100,000. 12 As mentioned above, with 3×3 games it can happen that two Nash regular games that have exactly the same Nash equilibria need not be Nash equivalent. This is illustrated by the following pair of games. (5, 3) (0, 0) (5, 2) (5, 3) (0, 0) (5, 2) γ6 = (4, 3) (2, 2) (2, 0) , γ7 = (0, 3) (5, 2) (0, 0) . (0, 0) (5, 2) (0, 3) (4, 0) (2, 2) (2, 3) Both games have the same Nash equilibria, namely the pure strategy equilibrium, where both players play strategy 1, the mixed strategy equilibrium where players 1 and 2 mix between respectively strategies 2 and 3, and 1 and 2, and, finally, the completely mixed equilibrium. To understand why the two games are not Nash equivalent, we point out that the indices of the two mixed strategy equilibria are reversed in the two games, where, following Shapley (1974), p. 184, we define the index of a regular Nash equilibrium σ ∈ S of a two person game γ = (A, B), as the number (+ or −1) given by: ind(σ, γ) = (−1)k+1 sgn(det(A0 )det(B 0 )), where det and sgn denote respectively the determinant and the sign, and A0 , B 0 are the k × k submatrices of A, B that are obtained from A, B by deleting all rows and columns that do not correspond to strategies that are in the support of σ, and possibly also by adding a positive constant to all payoffs so as to make all entries in A0 , B 0 strictly positive. It is easily verified that the completely mixed strategy equilibrium, in γ6 for example, has index +1, while it has index −1 in γ7 , and that the other mixed strategy equilibrium has index −1 in γ6 and +1 in γ7 . 4.4 Some General Properties In this section, we consider general finite two person games and derive, through some lemmas and propositions, a necessary condition for two games to be Nash equivalent. The following is a characterization of regular Nash equilibria in two person games. Theorem 1 Let γ ∈ IR2κ be a two person game in normal form and let σ ∈ N E(γ) be a Nash equilibrium of γ. Then the following are equivalent: (a) σ is locally unique, (b) σ is regular, (c) N E is locally continuous at (γ, σ). 13 P roof . We show (a) ⇒ (b) ⇒ (c) ⇒ (a). (a) ⇒ (b): Suppose σ is locally unique. Then the projection map π : IR2κ × S → IR2κ , (γ, σ) 7→ γ, restricted to U is a homeomorphism onto π(U ). This readily implies that ηN E is transverse to {γ} × S at (γ, σ) since the product of the projection maps from a coordinate neighborhood of (γ, σ) to IR2κ and to S essentially yield the desired homeomorphism. (b) ⇒ (c): Let Uγ ⊂ IR2κ and Uσ ⊂ S be as in Definition 2. If σ is regular, then, in particular, N E restricted to map from Uγ to Uσ will be single-valued at γ, and the homeomorphism ζ from the definition of regularity yields the rest. (c) ⇒ (a): This follows directly from van Damme (1991), Theorem 3.4.4, p. 55, and Lemma 2 above. (Notice that, in van Damme’s terminology, strongly stable corresponds to what we call locally unique.) 2 This characterization should not be surprising in view of the above mentioned theorem of van Damme. In particular, it shows that, when there are just two players, the Nash equilibrium correspondence is sufficiently well-behaved that the three notions, local uniqueness, (topological) regularity, and local continuity, that are different in general, in fact coincide for N E. While the implications (a) ⇒ (b) ⇒ (c) continue to hold for more than two players, (for the same reasons given in the proofs above), this need not be the case for the reverse directions. An immediate consequence of Theorem 1 is the following. Corollary 2 Let γ ∈ IR2κ be a two person game in normal form, then if γ is Nash regular, all its Nash equilibria are locally unique. This implies that the classification of Nash equivalence classes for generic two person games does not change if one requires games along the paths υ of Definition 4 to have all equilibria locally unique in addition to being Nash regular. The following theorem gives a characterization of regular games, which form a subset of the Nash regular games. The characterization is useful for the computation of Nash equivalence classes. Theorem 2 Let γ ∈ IR2κ be a two person game in normal form. Then the following are equivalent: (a) γ is regular, (b) βi is transverse to {γ} × (∩t∈Tj {σ ∈ S|σtj = 0}), for all Tj ⊂ Sj , j 6= i, and for i = 1, 2. 14 (c) any mixed strategy x ∈ S1 of player 1 has at most |supp(x)| pure best responses, and the same holds for any mixed strategy of player 2. P roof . We show (a) ⇒ (b) ⇒ (c) ⇒ (a). (a) ⇒ (b): This follows directly from the definitions. (b) ⇒ (c): We show ¬(c) ⇒ ¬(b). We make use of the following well-known lemma. (See for example von Stengel (1996), Theorem 2.4, p. 9.) Lemma 6 Let γ = (A, B) ∈ IR2mn be a two person m × n game in normal form, and let y ∈ S2 , then x ∈ IRm is a best reply to y if and only if there exist u ∈ IR such that,5 1Tm x = 1 (1) 1m u − Ay ≥ 0 (2) x (1m u − Ay) = 0 (3) x ≥ 0. (4) T Suppose (c) does not hold, i.e., suppose that player 1 has more best replies to y than there are strategies in the support of y. We show that β1 cannot be transverse to {γ}×(∩t∈T2 {σ ∈ S|σt2 = 0}), for some T2 ⊂ S2 . Suppose without loss that exactly the first s inequalities of (2) hold with equality and suppose that the first r strategies of player 2 are exactly the strategies in the support of y. The set of best replies to y forms a simplex of dimension s. Moreover, if player 1 has more pure best responses to y than there are strategies in the support of y, then s > r. Let T2 = {s2r+1 , . . . , s2n }, then we claim that if s > r, β1 cannot be transverse to {γ} × (∩t∈T2 {σ ∈ S|σt2 = 0}). To see this, notice that, by Lemma 1, the dimension of β1 is 2mn + n − 1. Also, the dimensions of IR2mn × S and {γ} × (∩t∈T2 {σ ∈ S|σt2 = 0}) are respectively 2mn + m + n − 2 and m + r − 1(= (m + n − 2) − (n − r − 1)). Now, recall that the set of vectors y 0 ∈ IRn that satisfy (2.1)-(2.s) for some value u0 ∈ IR form a linear subspace of IRn , which for generic A has dimension n − s. Requiring 1Tn y = 1 leads to a further linear subspace, which for generic A has dimension n − s − 1, and, finally, requiring y ≥ 0 leads to a subset of S2 which again for generic A has dimension n − s − 1 and moreover has exactly s nonzero entries. Therefore, for generic A, the dimension of β1 ∩({γ} × (∩t∈T2 {σ ∈ S|σt2 = 0})) is equal to r(= (2mn + n − 1) + (m + r − 1) − (2mn + m + n − 2)). But, if at the game γ, player 1 has s pure best responses to y ∈ ∩t∈T2 {σ ∈ S|σt2 = 0}), then the 5 A superscript T denotes the transpose, and 1r ∈ IRr stands for the r-vector of ones. 15 latter number will be s. Since s > r, this shows that β1 cannot be transverse to {γ} × (∩t∈T2 {σ ∈ S|σt2 = 0}), and hence (b) cannot hold. (c) ⇒ (a): Suppose (c) holds. Pick (γ, σ) ∈ β1 ∩ β2 , then (c) implies that σ ∈ S is uniquely determined by linearly independent equations, (see von Stengel (1996), Theorem 2.7, p. 20), which readily implies β1 ∩β2 is transverse to {γ}×S. Next we show that β1 is transverse to {γ}×(∩t∈T2 {σ ∈ S|σt2 = 0}) for all T2 ⊂ S2 . Fix T2 ⊂ S2 and pick (γ, σ) ∈ β1 ∩ ({γ} × (∩t∈T2 {σ ∈ S|σt2 = 0})). As in the proof of Lemma 5, it suffices to show that, for all γ 0 arbitrarily close to γ there exists (γ 0 , σ 0 ) ∈ β1 ∩ ({γ} × (∩t∈T2 {σ ∈ S|σt2 = 0})) arbitrarily close to (γ, σ). Again, this will show that for all γ 0 close to γ there exists 0 σ 2 ∈ ∩t∈T2 {σ ∈ S|σt2 = 0} arbitrarily close to σ 2 such that player 1’s set of best replies is a simplex of the same dimension as the one against σ 2 at γ. By (c), player 1 has at most |supp(σ 2 )| pure best responses against σ 2 at γ, which 0 in view of Lemma 6 readily implies that there exists σ 2 ∈ ∩t∈T2 {σ ∈ S|σt2 = 0} 0 such that player 1 has the same best responses against σ 2 at γ 0 as against σ 2 at γ. This in turn implies that for all γ 0 arbitrarily close to γ there exists (γ 0 , σ 0 ) ∈ β1 ∩ ({γ} × (∩t∈T2 {σ ∈ S|σt2 = 0})) arbitrarily close to (γ, σ). The same argument applies also for player 2 and β2 and therefore concludes the proof of the theorem. 2 The interpretation of (a) ⇔ (b) means in particular that, in order to verify regularity of a two person game, it suffices to verify that the payoff matrices A, B yield best-replies that are transverse to {γ} × (∩t∈Tj {σ ∈ S|σtj = 0}), for all Tj ⊂ Sj , j 6= i, individually for i = 1, 2. In other words, checking transversality of β1 , β2 with respect to the intersections of faces of S automatically guarantees that the intersection β1 ∩ β2 will be transverse to {γ} × S. This property no longer holds with more than two players. There, one cannot verify regularity by considering the payoff matrices of the different players independently of each other. The equivalence with condition (c) strengthens this result and gives a particularly operational characterization of regularity for the two player case.6 Our next theorem provides a necessary condition for two games to be Nash equivalent. Its proof makes use of the following lemma. Lemma 7 Let γ ∈ IR2κ be a two person game in normal form, and (γ, σ) ∈ ηN E . If N E is locally continuous at (γ, σ), then there exists a neighborhood U ⊂ ηN E of (γ, σ) such that for any two points (γ0 , σ0 ), (γ1 , σ1 ) ∈ U , we have, supp(σ0 ) = supp(σ1 ). 6 For more on this notion of regularity with two players, the reader is referred to von Stengel (1996), Section 2.6, p. 19-25. 16 P roof . From van Damme (1991), Theorem 3.4.4, p. 55, and Lemma 2 above, it follows that, if N E is locally continuous at (γ, σ), then every player has exactly as many best replies to σ i as there are strategies in the support of σ i , i = 1, 2. (In van Damme’s terminology, an equilibrium with such a property is called quasi strict.) But, if such a property holds at γ, it must also hold in a sufficiently small neighborhood of γ, and since σ is isolated, it must also hold in a neighborhood of (γ, σ). 2 Theorem 3 Let γ0 , γ1 ∈ IR2κ be two Nash regular two person games in normal form. If γ0 is Nash equivalent to γ1 , then there exist a symmetry operation ψ ∈ Ψ(m, n) and a support and index preserving bijection from the set of Nash equilibria of γ0 to the set of Nash equilibria of ψ(γ1 ). P roof . If γ0 and γ1 are Nash regular and γ0 ∼N E γ1 , then γ0 , γ1 , and ψ 0 (γ1 ), for any ψ 0 ∈ Ψ(m, n), must have the same (finite) number of Nash equilibria. Hence it is easy to see that there exists a bijection between N E(γ0 ) and N E(ψ 0 (γ1 )), for any ψ 0 ∈ Ψ(m, n). To see that there must exist a bijection that preserves the supports of the elements of N E(γ0 ), N E(ψ(γ1 )), for some ψ ∈ Ψ(m, n), notice that otherwise it would not be possible to join the games γ0 and ψ(γ1 ) by means of a path of Nash regular games. This follows immediately from Lemma 7, since it would not be possible to join them by means of a path of games along which N E is locally continuous at all Nash equilibria, and by Theorem 1, which implies that local continuity at all Nash equilibria of a given game is equivalent to Nash regularity of the game. Similarly, if, in addition, one could not require the bijection to preserve the indices of all Nash equilibria, it would also not be possible to join the games γ0 and ψ(γ1 ) by means of a path of Nash regular games, since all indices are invariant (individually) along such a path. This completes the proof of the theorem. 2 The converse of the theorem is false, as the following pair of 3 × 4 games show: (4, 3) (3, 4) (−3, −2) (−3, −3) (4, 3) (1, 2) (−1, −8) , γ8 = (3, 4) (−6, −2) (0, 0) (5, 1) (5, 3) (3, 4) (4, 3) (−3, −2) (−3, −3) (3, 4) (1, 2) (−1, −8) . γ9 = (4, 3) (−6, −2) (−1, −1) (5, 1) (5, 3) Both games have the same Nash equilibria, namely the pure strategy equilibrium where the players play respectively strategies 3 and 4, and the two mixed 17 strategy equilibria where both players mix between the strategies 1 and 2, and 2 and 3. Not only do the equilibria of the two games coincide, but the indices of the equilibria across the games coincide as well. Nonetheless, it is possible to show that the two games are not Nash equivalent. To see why, observe that, in some sense, the orientation of the mixed strategy equilibrium where both players mix over strategies 1 and 2 is reversed across games, while all other entries are essentially unchanged. As a consequence it is no longer possible to join the two games by means of a path of Nash regular games. Applying symmetry operations to the games does not make any difference. This counterexample raises the question of whether and why the games γ8 and γ9 should be considered as strategically different, (especially from the viewpoint of Nash equilibrium). For example one can conceive of equivalence classes where the necessary condition of Theorem 3 is also sufficient for two games to be equivalent. We leave this as well as the question of what is a sufficient condition for Nash equivalence (as in Definition 4) for future research. The theorem above also does not extend to more than two players. This is illustrated by the following example, which is a slight variant of the three person 2 × 2 × 2 game given in Kojima, Okada, and Shindoh (1985), p. 662. ÃÃ γ10 = (1, 1, 1) (2, 1, 0) (2, 2, 1) (0, 3, 1) ! Ã (1, 1, 1) (5, 0, 2) (3, 2, 0) (3, 3, 0) !! . The game has a unique Nash equilibrium σ = ((.5, .5), (.5, .5), (0, 1)), which can be shown to be locally unique and hence also regular and locally continuous. However, it is not the case that all equilibria close by have the same support as σ. In particular, there are games arbitrarily close to γ10 with a unique completely mixed equilibrium arbitrarily close to σ. Therefore, since such close by games will be Nash equivalent, this would violate the necessary condition of Theorem 3 as well as Lemma 7 showing that these do not extend to more than two players. Next, we consider the relationship of the Nash equivalence classes with equivalence classes induced by other equilibrium concepts for simple classes of games. 4.5 Other Equilibrium Concepts The analysis carried out in the previous sections for the Nash equilibrium concept can be extended to other equilibrium concepts. In this section, we define equivalence classes for the concepts of rationalizability, iterated strict dominance, and correlated equilibrium. The reader is referred to, for exam18 ple, Fudenberg and Tirole (1991), Ch. 2, p. 45-59, for definitions of these equilibrium concepts. 4.5.1 Rationalizability and Iterated Strict Dominance The cases of rationalizability and iterated strict dominance are straightforward. A natural definition of equivalence with respect to these concepts is to say that two n-person games γ0 , γ1 ∈ IRκn are equivalent, if, for each player, the number of either the rationalizable strategies or of the strategies that remain after all strictly dominated strategies have been eliminated, coincides across the games γ0 and γ1 . As one expects, equivalence in this sense amounts to simply counting, for each player, the number of either rationalizable strategies or of strategies that survive iterated strict dominance. By considering the games at which these numbers change, one obtains a subset of the singular games that also divides the space of games into finitely many connected components. In the case of the Nash regular 2 × 2 games, the equivalence classes with respect to iterated strict dominance are the two classes of games consisting of the games with respectively one and two undominated strategies for each player. In particular, unlike the case of Nash equivalence, equivalence classes with respect to rationalizability or iterated strict dominance do not distinguish between matching pennies and coordination games. (Notice that the latter two concepts coincide for two player games, see for example Fudenberg and Tirole (1991), Theorem 2.2, p. 51.) However, one should not deduce from the 2 × 2 games nor from the 2 × 3 games that two games that are Nash equivalent will also be equivalent with respect to rationalizability or iterated strict dominance. This is illustrated by the following pair of 3 × 3 games. γ11 (5, 3) (5, −1) (0, 0) (5, 3) (5, 2) (0, 0) = (2, 2) (2, −1) (4, 3) , γ12 = (2, 2) (2, 0) (4, 3) . (0, 0) (0, −1) (5, 3) (0, 0) (0, 2) (5, 3) Both games have three Nash equilibria, two pure where both players play strategies 1 and 3, and a mixed strategy equilibrium where they mix respectively between strategies 1 and 2 and 1 and 3. Notice that in neither of the games is player 2’s strategy 2 used, and, in γ11 it is actually strictly dominated. While moving from game γ11 to γ12 does not affect the Nash equilibrium correspondence, the set of rationalizable strategies goes from containing only strategies 1 and 3 for player 2 at γ11 to containing strategies 1, 2, and 3 at γ12 . 19 The following captures a basic link between the Nash and the rationalizable or the iterated strict dominance equivalence classes. Lemma 8 Let γ ∈ IR2κ be a two person game in normal form. Then, if γ is regular, the set of rationalizable strategies or of strategies surviving iterated strict dominance is locally constant. In fact, if γ ∈ IRκn is a regular n-person game then the set of strategies surviving iterated strict dominance is locally constant. P roof . Consider the set strategies surviving iterated strict domonance at γ and denote this set by U = U1 × U2 . Suppose moreover that this set changes at γ. Then there exists at least one player, say 1, who has a strategy that is either redundant or weakly but not strictly dominated within U . But then, by Lemma 5 this implies that β1 restricted to IR2κ × U is not transverse to {γ} × U, where U is the set of probability measures on U . Hence β1 is not transverse to {γ} × S1 × ({0} × U2 ), which is equal to {γ} × (∩t∈S2 \U2 {σ ∈ S|σt2 = 0}). By definition of regularity this implies that γ cannot be regular. For rationalizability, use the fact mentioned above that, for two players, the set of rationalizable strategies coincides with the set of strategies surviving iterated strict dominance. Finally, the case of iterated strict dominance where γ is an n-person game is analogous to the two person case. 2 4.5.2 Correlated Equilibria The case of correlated equilibria is somewhat less straightforward than the cases of rationalizability and iterated strict dominance. If we view a correlated equilibrium of a given n-person game γ ∈ IRκn as a probability measure over the set of pure strategy profiles S, which unlike with the Nash equilibria, we do not restrict to being a product measure, then we can view the correlated equilibrium correspondence ηCE as a subset of IRκn × ∆(S), where ∆(S) is the set of all probability measures on S. Moreover, since the set of correlated equilibria CE(γ) ⊂ ∆(S) of any given game γ ∈ IRκn is a compact, convex polyhedron described by a finite number of linear inequalities, it has a welldefined dimension. We use this to define a notion of equivalence with respect to correlated equilibrium. Definition 6 Let IRκn be the space of K1 × · · · × Kn games in normal form with n players, we say the games γ0 , γ1 ∈ IRκn are correlated equivalent, which we denote by γ0 ∼CE γ1 , if there exists a symmetry operation ψ ∈ Ψ(K1 , . . . , Kn ), and a continuous path υ : [0, 1] → IRκn , with υ(0) = γ0 and υ(1) = ψ(γ1 ), such that, for all γ ∈ υ([0, 1]), the dimension of the set of correlated equilibria CE(γ) is constant. 20 Notice that unlike the definition of Nash equivalence, the notion of correlated equivalence is defined over all games, i.e., not just over the Nash regular ones. Nonetheless, we will continue to focus only on Nash regular games. An alternative definition would have been to require the set of correlated equilibria of all games along the path υ to have the same number of vertices rather than the same dimension. However, we believe that this would lead to too many different equivalence classes to be distinguished and we do not pursue the idea further. (For example, the sets of correlated equilibria of the 3 × 3 games γ6 and γ7 have respectively 170 and 107 vertices, while the dimension of the sets is 8 in both cases.) With the above definition of correlated equivalence, it can be shown that the space of Nash regular 2 × 2 games is decomposed into exactly the same equivalence classes using corelated equivalence as using Nash equivalence. That is, one obtains again the three representative games γ1 , γ2 , and γ3 , that are representative of the same classes of games, i.e., [γi ]CE = [γi ], for i = 1, 2, 3, where [γ]CE denotes the correlated equivalence class that contains the game γ. To see that γ1 and γ2 represent different correlated equivalence classes although the sets of correlated equilibria are singletons in both cases, we point out that there is no way to join the two games without passing through games whose set of Nash equilibria and hence also of correlated equilibria has dimension at least 1. With the 2 × 3 games, it can be shown that the two classifications no longer coincide. In fact, the games γ4 and γ5 that are distinguished by Nash equivalence are no longer distinguished by correlated equivalence as can be seen by considering the straight paths between the games γ4 and γ40 , between γ40 and γ400 , and between γ400 and γ5 , where: Ã γ40 = (1, 3) (0, 2) (0, 0) (0, 0) (1, 2) (0, 3) ! Ã , γ400 = (1, 3) (0, 2) (0, 0) (0, 0) (0, 2) (1, 3) ! . It is easily verified that the set of correlated equilibria remains full dimensional along the entire path. This shows that two games that are correlated equivalent need not be Nash equivalent. Further examples of this can be found among the 3 × 3 games. Among the 3 × 3 games one also finds examples of games that are Nash equivalent but not correlated equivalent. This can be seen from the games γ11 and γ12 of the previous section. Although both games are Nash equivalent, they are not correlated equivalent, as the dimension of the set of correlated equilibria changes from 5 to 8. However, it is possible to show that the analogue to Corollary 1 and Lemma 8 holds also for correlated equivalence. This provides a basic com21 mon property of all equivalence concepts considered in this paper at least for the two player case. Theorem 4 Let γ ∈ IR2κ be a two person game in normal form. If γ is regular, then the dimension of the set of correlated equilibria CE(γ) is locally constant. P roof . We make use of the following well-known lemma. (See for example Fudenberg and Tirole (1991), Ch. 2, p. 57.) Lemma 9 Let γ = (A, B) ∈ IR2mn be a two person game in normal form. Then p ∈ IRmn is a correlated equilibrium of γ if and only if it is a solution to the linear inequalities: Cp ≥ 0, 1mn p = 1, and p ≥ 0, (5) where C is the (m(m − 1) + n(n − 1)) × mn matrix defined by: a11 − a21 .. . a11 − am1 b11 − b12 .. . b11 − b1n 0 .. . 0 ··· ··· a1n − a2n .. . 0 a1n − amn .. . am1 − a11 .. . 0 am1 − am−1,1 bm1 − bm2 .. . ··· 0 .. . ··· .. . ··· 0 bm1 − bmn b1n − b11 .. . 0 .. . · · · b1n − b1,n−1 ··· ··· 0 ··· amn − a1n .. . · · · amn − am−1,n ··· 0 .. . ··· .. . ··· ··· 0 bmn − bm1 .. . . bmn − bm,n−1 Let E be the matrix consisting of all rows of (C 1mn Imn )T , that hold with equality for all vectors p ∈ IRmn satisfying (5) at a given game γ.7 Then, as a direct application of a well-known result from polyhedral theory, (see for 7 We say a row of C or Imn holds with equality or strict inequality at γ, if the corresponding inequality of (5) holds with equality or with strict inequality. 22 example Nemhauser and Wolsey (1988), Proposition 2.4, p. 87), it follows that the dimension of the set of correlated equilibria of γ is equal to mn−rank(E). Therefore, it suffices to show that the rank of E is locally constant at γ. To avoid confusion, we will fix E to consist of all rows holding with equality at the given, regular game γ, so that as we change γ, we keep the set of rows of E fixed while allowing the entries to vary. This means that the only way the dimension of the correlated equilibria can change as γ changes is (i) that the rank of E changes or (ii) that there exists a row of (C 1mn Imn )T not belonging to E at γ that holds with equality for all correlated equilibria of a close by game γ 0 and moreover is linearly independent from the rows of E at γ 0 . We show that neither case can arise if γ is regular. First, notice that if a row of (C 1mn Imn )T does not belong to E, then it must be linearly independent from the rows of E at γ. And if it is linearly independent from E, and the span of the rows of E does not increase with small perturbations of γ, it will continue to be linearly independent from the rows of E, and moreover, there will be correlated equilibria of the perturbed games at wich such a row will continue to hold with strict inequality. Therefore, it remains to show that the span of the rows of E cannot be increased by slight perturbations of γ when γ is regular. Since the number of linearly independent rows of E cannot decrease locally, it suffices to show that it cannot increase either. To show this, we make use of the following lemma. Lemma 10 Let γ = (A, B) ∈ IR2mn be regular two person game in normal form and C as above, let D be any submatrix obtained from (C 1mn )T by deleting all rows corresponding to strictly dominated strategies and possibly more,8 then D has full row rank, i.e., rank(D) = min {mn, number of rows of D}. Before proving this lemma, we conclude the proof of the theorem. Notice that any strictly dominated strategy has probability zero at any correlated equilibrium, which implies that any row of C corresponding to a strictly dominated strategy either holds trivially with equality for all correlated equiliria (i.e., because all corresponding entries of the correlated equilibria are zero), or it holds with strict inequality for some correlated equilibrium. (This can be seen by inspection of the matrix C above.) This implies that all the rows of E that correspond to strictly dominated strategies are ones where all corresponding entries of all correlated equilibria are zero, which in turn implies that 8 We say a row of C corresponds to a strategy sik ∈ Si if it contains aks , for some s = 1, . . . , n, when i = 1 or if it contains btk for some t = 1, . . . , m, when i = 2. 23 the corresponding rows of Imn must also be contained in E. In other words the rows of E that correspond to strictly dominated strategies are spanned by corresponding rows of Imn . Hence the span of these rows together with the corresponding rows of Imn cannot be increased by varying γ locally. It remains to see whether it is possible to increase the span of the remaining rows, i.e., whether it is possible to increase the rank of the matrix D obtained from E after deleting all rows corresponding to strictly dominated strategies as well as the corresponding rows of Imn . By the lemma above, such a matrix has full row rank. This implies that it is not possible, by perturbing its entries to increase its rank. As a consequence, perturbing γ will not increase the rank of such a submatrix D. But then, we have shown that perturbing γ will not affect the rank of E, and hence the dimension of the set of correlated equilibria must remain locally constant. 2 We come back to the proof of Lemma 10 P roof of Lemma 10. It suffices to consider the statement of the lemma for the case where D is the full matrix C, assuming that the original game has no strictly dominated strategies. For, if a game is regular, then, the reduced game obtained after iteratedly eliminating all strictly dominated strategies will continue to be regular. Moreover, it will have neither redundant nor weakly dominated strategies. But then, a close inspection of the matrix C shows that it must have full row rank since the columns of any set of at least mn rows of C are linearly independent. To see this it may be useful to rewrite the matrix C as the difference of two matrices C1 and C2 in the obvious way, and recall that regularity of a game with no strictly dominated strategies implies that the submatrices of A and B T appearing in C2 will have full row rank (see von Stengel (1996), Theorem 2.7, p. 20). This implies that any set of at most mn rows of C are linearly independent, and the statement of the lemma then follows. 2 5 Related Literature It was already mentioned in the introduction that the literature concerning equivalence classes or classifications of normal form games is astonishingly small. Besides the classic distinctions such as between zero-sum and non-zerosum or constant-sum and non-constant-sum games, or between coordination, common interest games and purely competitive games, or simply between normal form and extensive form games, there has been very little work that has, as its object, the classification of games into typically finitely many classes 24 using standard (non-cooperative) equilibrium concepts. Some exceptions are the works of Rapoport, Guyer, and Gordon (1976) who classify 2 × 2 two person games into 78 strategically different classes of games and suggest that these can be further identified into 24 different classes. However, it is not clear how the distinctions made relate to standard non-cooperative equilibrium concepts and, as Bárány et al. (1992), p. 268, point out, it is not clear how their procedure extends to larger games. Bárány, Lee, and Shubik (1992) classify ordinal two person m × n games according to the outcome sets generated by the payoff matrices, although they also mention the possibility of using properties of the best reply or other noncooperative equilibrium correspondences to derive alternative classifications. In particular, they obtain asymptotic bounds for the number of different classes of games (≈ (mn)2mn ) and for the number of different classes of outcome sets (≈ (mn)mn ). Their classification distinguishes 78 strategically different two person 2×2 games and already over 65 billion strategically different two person 3 × 3 games. Also here, it is also not immediate to us how and to which noncooperative equilibrium concepts the shapes of the outcome sets relate to. In the mathematics literature, Conway (1976) addresses the question of classifying games within the particular class of so-called nim-type games. These are two person zero sum games where agents make sequential moves, one after the other, choosing from a given set of strategies that decreases as agents make moves. Conway shows that the set of equivalence classes of these nim-type games can be identified with the space of nonstandard numbers. Although the class of nim-type games does not seem to be of particular relevance to the social sciences, its classification shows that equivalence classes of games may indeed have a very particular structure.9 However, besides several papers (such as for example Carlsson and van Damme (1993) and Morris, Rob, and Shin (1995)) that define classes of games in order to show that certain properties hold over all games within the class, no other literature was found that addresses the question of systematically classifying normal form games according to the more standard equilibrium concepts used in (non-cooperative) game theory such as correlated or Nash equilibrium. 9 For further literature on nim-type and related games see also Berlekamp et al. (1982), Conway (1991), and Guy (1991). 25 6 Conclusion The present paper has introduced a procedure for identifying games into broad equivalence classes that are defined using very basic topological characteristics of equilibrium correspondences. This was seen to lead to an organization of the spaces of games into a typically finite number of well-defined equivalence classes, which also constitute a classification of the underlying space of games, according to the given equilibrium concept. We find the proposed procedure as providing a useful way of thinking about srategic situations and of comparing equilibrium concepts. However, many questions are left unanswered, (see especially Sections 4.4 and 4.5), and we view the present paper as a first step in a possibly large field. A question we think is particularly important is that of finding sufficient conditions that can be imposed directly on a pair of games to decide whether they are equivalent with respect to one or the other of the equivalence concepts introduced. In fact, the presented procedure of defining equivalence classes can be viewed as being in some sense the reverse of the more direct procedure of defining equivalence classes based on properties only of the pairs of games to be compared, i.e., without invoking properties of further games along a path. One would then require all games within an equivalence class to be invariant with respect to the given properties. We view such an approach as complementary to the approach taken in this paper, where the mentioned sufficient conditions for deciding equivalence between two games play the role of the invariance properties relative to the underlying equivalence concept. Some further questions we think are important are to obtain a more operational characterization of Nash regularity for more than two players, to understand the structure of the set of all equivalence classes for Nash and correlated equilibria for a given space of games, and to see how these change when strategies and/or players are added. It would also be interesting to obtain a clearer understanding of the relationship between the Nash equivalence classes and the correlated and rationalizability equivalence classes. Another question that has not been addressed at all in the present paper, is whether one can use the classifications to obtain insights about singular games in order to say something about robustness and refinements of equilibria. What we have in mind is to use the equivalence classes of games around a given component of Nash equilibria to say something about the component and about some of the individual equilibria contained in it. A further possibility would be to define equivalence classes for Nash singular games, using different refinements of the Nash equilibrium concept and to compare the resulting equivalence classes with each other. In fact, the equivalence classes defined 26 with respect to rationalizability, iterated dominance, and correlated equilibria were defined for arbitrary normal form games and hence also for singular and Nash singular games and may turn out to be useful in this context. References [1] Bárány, I., J. Lee, and M. Shubik (1992) “Classification of Two-Person Ordinal Bimatrix Games,” International Journal of Game Theory, 21: 267-290. [2] Berlekamp, E.R., J.H. Conway, and R.K. Guy (1982) Winning Ways for your Mathematical Plays, Academic Press, London. [3] Blume, L.E. and W.R. Zame (1994) “The Algebraic Geometry of Perfect and Sequential Equilibrium,” Econometrica, 62: 783-794. [4] Carlsson, H. and E. van Damme (1993) “Global Games and Equilibrium Selection,” Econometrica, 61: 989-1018. [5] Conway, J.H. (1976) On Numbers and Games, Academic Press, London. [6] Conway, J.H. (1991) “Numbers and Games,” Proceedings of Symposia in Applied Mathematics, 43: 23-34. [7] Crawford, V.P. (1997) “Theory and Experiment in the Analysis of Strategic Interaction,” in D.M. Kreps and K.F. Wallis (eds.), Advances in Economics and Econometrics: Theory and Applications, I, Seventh World Congress of the Econometric Society, Cambridge University Press, Cambridge. [8] Fudenberg, D. and J. Tirole (1991) Game Theory, MIT Press, Cambrgidge, MA. [9] Greenberg, M.J. and J.R. Harper (1981) Algebraic Topology: A First Course, Addison-Wesley, New York. [10] Guy, R.K. (1991) “What is a Game?,” Proceedings of Symposia in Applied Mathematics, 43: 1-22. [11] Harsanyi, J. (1973) “Oddness of the Number of Equilibrium Points: A New Proof,” International Journal of Game Theory, 2: 235-250. [12] Kohlberg, E. and J.F. Mertens (1986) “On the Strategic Stability of Equilibria,” Econometrica, 54: 1003-37. 27 [13] Kojima, M., A. Okada, and S. Shindoh (1985) “Strongly Stable Equilibrium points of N -Person Noncooperative Games,” Matematics of Operations Research, 10: 650-663. [14] Mertens, J.-F. (1987) “Ordinality in Non-Cooperative Games,” CORE Discussion Paper No. 8782. [15] Morris, S., R. Rafael, and H.S. Shin (1995) “p-Dominance and Belief Potential,” Econometrica, 63: 145-157. [16] Nash, J. (1951) “Non-Cooperative Games,” Annals of Mathematics, 54: 286-295. [17] Nemhauser, G.L. and L.A. Wolsey (1988) Integer and Combinatorial Optimization, Wiley and Sons, New York. [18] Rapoport, A., M.J. Guyer, and D.G. Gordon (1976) The 2 × 2 Game, University of Michigan Press, Ann Arbor. [19] Roth, A.E. and I. Erev (1995) “Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term,” Games and Economic Behavior, 8: 164-212. [20] Roth, A.E. and I. Erev (1997) “Modeling how people play games: Reinforcement Learning in Experimental Games with Unique Mixed Strategy Equilibria,” mimeo, University of Pittsburgh. [21] Schanuel, S.H., L.K. Simon, and W.R. Zame (1991) “The Algebraic Geometry of Games and the Tracing Procedure,” in R. Selten (ed.), Game Equilibrium Models, II: Methods, Morals, and Markets, Springer Verlag, Berlin. [22] Shapley, L.S. (1974) “A Note on the Lemke-Howson Algorithm,” Mathematical Programming Study, 1: 175-189. [23] Van Damme, E. (1991) Stability and Perfection of Nash Equilibria, 2nd ed., Springer Verlag, Berlin. [24] Von Stengel, B. (1996) “Computing Equilibria for Two-Person Games,” ETHZ, Institut für theoretische Informatik, Technical Report # 253, forthcoming in R. Aumann and S. Hart (eds.), Handbook of Game Theory, III, North-Holland, Amsterdam. 28 7 Appendix The following is a classification of 3 × 3 Nash regular games. With the help of a computer program we obtained 32 distinct Nash equivalence classes, each of which is unambiguously represented by a representative game ρi , i = 1, . . . , 32. Games with one Nash equilibrium. Zero pure strategy equilibria, zero completely mixed:10 (2, 1) (1, 2) (1, 0) (1, 2) (2, 1) (2, 0) . (0, 2) (0, 1) (0, 0) Zero pure strategy equilibria, one completely mixed: (5, 1) (5, 0) (0, 3) (2, 0) (2, 3) (2, 0) . (0, 3) (0, 1) (5, 0) One pure strategy equilibrium, zero completely mixed: (2, 2) (2, 1) (2, 0) (1, 2) (1, 1) (1, 0) . (0, 2) (0, 1) (0, 0) Games with three Nash equilibria. Zero pure strategy equilibria, zero completely mixed: (5, 0) (0, 3) (5, 2) (5, 0) (0, 3) (5, 2) (2, 0) (4, 2) (2, 3) , (2, 0) (2, 2) (4, 3) . (0, 3) (5, 2) (0, 0) (0, 3) (5, 2) (0, 0) Zero pure strategy equilibria, one completely mixed: (0, 3) (5, 0) (0, 1) (5, 0) (0, 3) (5, 1) . (2, 1) (2, 0) (4, 3) 10 All remaining equilibria are mixed strategy equilibria with two pure strategies in each player’s support. 29 One pure strategy equilibrium, zero completely mixed: (2, 3) (2, 0) (1, 2) (5, 3) (0, 0) (5, 2) (1, 0) (1, 3) (2, 2) , (2, 3) (4, 2) (2, 0) , (0, 3) (0, 2) (0, 0) (0, 0) (5, 2) (0, 3) (5, 3) (0, 0) (5, 2) (3, 5) (1, 2) (1, 0) (2, 0) (4, 2) (2, 3) , (0, 0) (3, 4) (0, 5) , (0, 3) (5, 2) (0, 0) (1, 5) (0, 2) (3, 0) (5, 5) (0, 0) (5, 4) (5, 3) (0, 2) (0, 0) (2, 0) (4, 5) (2, 2) , (4, 0) (2, 2) (2, 3) . (0, 5) (5, 0) (0, 2) (0, 3) (5, 0) (5, 2) One pure strategy equilibrium, one completely mixed: (5, 3) (0, 0) (5, 2) (5, 3) (0, 0) (5, 2) (4, 3) (2, 2) (2, 0) , (0, 3) (5, 2) (0, 0) , (0, 0) (5, 2) (0, 3) (4, 0) (2, 2) (2, 3) (5, 3) (0, 0) (5, 1) (5, 3) (0, 0) (5, 2) (4, 1) (2, 3) (2, 0) , (2, 0) (2, 2) (4, 3) , (0, 1) (5, 0) (0, 3) (0, 3) (5, 2) (0, 0) (3, 3) (3, 1) (0, 0) (2, 1) (0, 3) (3, 0) , (0, 1) (2, 0) (2, 3) Two pure strategy equilibria, zero completely mixed: (2, 2) (1, 1) (2, 0) (2, 3) (2, 2) (1, 0) (1, 1) (2, 2) (1, 0) , (1, 0) (1, 2) (2, 3) , (0, 2) (0, 1) (0, 0) (0, 3) (0, 2) (0, 0) (5, 5) (5, 2) (0, 0) (5, 3) (5, 2) (0, 0) (2, 5) (2, 2) (4, 0) , (2, 0) (2, 2) (4, 3) . (0, 0) (0, 4) (5, 5) (0, 2) (0, 0) (5, 3) Two pure strategy equilibria, one completely mixed: (5, 3) (5, 1) (0, 0) (4, 1) (2, 3) (2, 0) . (0, 1) (0, 0) (5, 3) 30 Games with five Nash equilibria. One pure strategy equilibrium, zero completely mixed: (3, 5) (0, 2) (5, 0) (2, 0) (4, 4) (2, 5) . (0, 5) (5, 2) (0, 0) Two pure strategy equilibria, zero completely mixed: (5, 3) (5, 0) (0, 2) (5, 3) (5, 0) (0, 2) (2, 0) (2, 3) (4, 2) (2, 0) (4, 3) (2, 2) . , (0, 2) (0, 0) (5, 3) (0, 0) (0, 2) (5, 3) Two pure strategy equilibria, one completely mixed: (5, 5) (5, 4) (0, 0) (5, 3) (5, 2) (0, 0) (4, 5) (2, 2) (2, 0) , (4, 2) (2, 0) (2, 3) , (0, 0) (0, 2) (5, 5) (0, 0) (0, 2) (5, 3) (5, 3) (5, 1) (0, 0) (5, 5) (5, 2) (0, 0) (2, 1) (4, 3) (2, 0) , (2, 0) (4, 4) (2, 5) . (0, 0) (0, 1) (5, 3) (0, 0) (0, 2) (5, 5) Three pure strategy equilibria, zero completely mixed: (3, 3) (0, 2) (0, 0) (3, 3) (2, 2) (2, 0) (1, 0) (3, 3) (1, 2) (2, 2) (3, 3) (0, 0) . , (0, 0) (1, 2) (3, 3) (0, 0) (0, 2) (3, 3) Games with seven Nash equilibria. Three pure strategy equilibria, one completely mixed: (3, 3) (1, 1) (1, 0) (1, 1) (3, 3) (0, 0) . (0, 1) (0, 0) (3, 3) 31
© Copyright 2026 Paperzz