AGGRESSIVE BEHAVIOR Volume 32, pages 294–307 (2006) ‘‘We’re Not Friends Anymore! Unlessy’’: The Frequency and Harmfulness of Indirect, Relational, and Social Aggression Sarah M. Coyne, John Archer, and Mike Eslea Department of Psychology, University of Central Lancashire, Preston, UK : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : The frequency of items of indirect, relational, social, verbal, and physical aggression was assessed in the school environment of 422 adolescents, using the Indirect/Social/Relational Aggression scale (ISRA), a measure that combined items from indirect, relational, and social aggression research. We also assessed the perceived harmfulness of each item. Comparing these findings with the occurrence of aggression on television, we found that adolescents were exposed to nearly 10 times more indirect, relational, and social aggression on television than they are in school. Overall, there was no sex difference in the amount of aggression reported by boys and girls. However, when examining specific items, girls reported more gossiping and boys more hitting. Girls perceived indirect, direct relational, and verbal aggression as more harmful than did boys. Limited evidence was found for a distinction between indirect, relational, and social aggression, although it was clear that they were more similar than different. Aggr. Behav. 32:294–307, 2006. r 2006 Wiley-Liss, Inc. : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : Keywords: indirect aggression; relational aggression; social aggression; television; sex differences INTRODUCTION ‘‘Hey, did you hear the news about Alicia?’’ ‘‘Ew! Don’t hang out with him! He’s so gross!’’ ‘‘We’re not friends anymore! Unlessy’’ These quotes are all examples of manipulative and often covert forms of behavior known as indirect, relational, or social aggression. These forms of behavior have been found to be very emotionally harmful to victims. Victims of indirect, relational, and social aggression have been found to be more depressed, anxious, lonely, and to have more negative thoughts in a variety of categories, including physical appearance, romantic appeal, global selfworth, and close friendships [e.g., Craig, 1998; Eslea, 2005; Henington et al., 1998; Paquette and Underwood, 1999], although it should be noted that the relationship between victimization and these attributes may be bi-directional. These hurtful behaviors occur frequently, especially in adolescent girls’ social groups [e.g., Crick et al., 1999]. Although there may be subtle differences between indirect, relational, and social aggression [Archer, 2001], in a review of the r 2006 Wiley-Liss, Inc. relevant research [Archer and Coyne, 2005], we argued that they are much more similar than they are different, and suggest ways in which the three terms can be integrated into one research area. Indirect Aggression One major feature of indirect aggression, according to the Finnish research team which originally examined it, is that ‘‘the aggressor may remain unidentified, thereby avoiding both counterattack from the target and disapproval by others’’ [Lagerspetz et al., 1988, p 404]. The defining feature of indirect aggression is that harm is delivered circuitously, in a covert manner [Björkqvist et al., 1992c]. Examples of indirect aggression include gossiping, spreading rumors, writing nasty notes to others, and trying to get others to exclude a group member. Indirect aggression may be verbal or physical Correspondence to: S.M. Coyne, Department of Psychology, University of Central Lancashire, Preston PR1 2 HE, UK. E-mail: [email protected] Accepted 9 November 2004 Published online 21 February 2006 in Wiley InterScience (www. interscience.wiley.com). DOI: 10.1002/ab.20126 Indirect, Relational, and Social Aggression 295 [Buss, 1961], although the emphasis is usually on its non-physical forms. Verbal indirect aggression includes the examples mentioned above. Examples of physical indirect aggression include covertly destroying someone’s property or robbing them. In the earlier research on indirect aggression, researchers did not make this distinction, but focused on verbal indirect aggression. A more recent definition, however, takes the physical forms into account by defining indirect aggression as ‘‘attempts to cause psychological, in rare cases even physical harm to the target person by social manipulation, often attacking the target in circuitous ways through a third person in order to conceal the aggressive intent, or otherwise pretending that the attack was not aggressive at all’’ [Björkqvist et al., 2001, p 112]. The covert nature of the behavior is nevertheless stressed. Indirect aggression is typically found to be more common among girls than boys up to the age of 18 years [e.g., Björkqvist et al., 1992b; Fesbach, 1969; Kaukiainen et al., 2001; Salmivalli et al., 2000]. One of the most important aspects of an adolescent girl’s life is her standing in the social world. Indirect aggression that potentially could harm a girl’s social standing in the group may be a particularly effective way of hurting her at this age [Björkqvist et al., 1992b]. However, it should be noted that several studies of adults have found no sex difference in indirect aggression [e.g., Green et al., 1996; Richardson and Green, 1999; see Archer, 2004]. By adulthood, being popular in the ‘‘social world’’, although still important, becomes less of a priority than in adolescence. Therefore, any sex differences in indirect aggression by adulthood may become less apparent when compared to adolescence [e.g., Green et al., 1996]. Relational Aggression Relational aggression is similar to indirect aggression, but focuses on ‘‘behaviors that harm others through damage to relationships or feelings of acceptance, friendship, or group inclusion’’ [Crick et al., 1999, p 77]. Relational aggression does not need to be covert. Rather, it is often carried out directly in front of the victim: e.g., a girl telling her friend that they will no longer be friends unless she does what the girl wants. Relational aggression researchers argue that this construct is distinct from indirect aggression [Crick et al., 1999]. Indirect aggression researchers, however, maintain that the two terms are identical [Björkqvist, 2001]. Although several items of relational aggression fit the definition of indirect aggression (e.g., gossiping, and backbiting), others do not (e.g., ignoring or stop talking to someone). These are often included in measures of indirect aggression [Archer and Coyne, 2005], so that the two constructs may be more similar in practice than their definitions indicate. Relational aggression has also been found to occur more frequently in girls than boys [Crick and Grotpeter, 1995; Crick et al., 1997], although some studies have found no sex difference [Deveaux and Daniels, 2000; Hart et al., 1998; Henington et al., 1998]. Several primitive forms of direct relational aggression may appear at earlier ages than covert forms of aggression [Crick et al., 1999]. Preschoolers typically use these direct forms of relational aggression (e.g., ‘‘We’re not friends unless you share your ice cream cone with me!’’) and then progress to more subtle forms as they mature and gain the social intelligence needed to effectively manipulate the social environment to their advantage [Salmivalli et al., 2000]. Social Aggression Social aggression is very similar to both relational and indirect aggression. It is a term coined by Cairns et al. [1989], and expanded by Galen and Underwood [1997, p 589], who described it as behavior which is ‘‘directed toward damaging another’s selfesteem, social status, or both, and may take such direct forms as verbal rejection, negative facial expressions or body movements, or more indirect forms such as slanderous rumors or social exclusion’’. It appears that social aggression encompasses all the behaviors in relational and indirect aggression, while adding harmful non-verbal behaviors (e.g., rolling eyes, giving dirty looks) to the construct. Underwood et al. [2001, p 252] suggest that researchers use the term social aggression because it ‘‘so aptly describes what might be at least one purpose of these behaviors’’. Unfortunately, researchers are still arguing as to whether indirect, relational, and social aggression are all distinct forms of aggression, and what to call it if they are essentially the same constructs [Archer and Coyne, 2005; Underwood et al., 2001]. Indirect, Relational, and Social Aggression on Television Indirect, relational, and social aggression not only occur in the playground and the classroom, but also on television, although the research in this field is still in the early stages. Coyne and Archer [2004] found that these forms of aggression occur more frequently on television than do physical and verbal Aggr. Behav. DOI 10.1002/ab 296 Coyne et al. aggression. They are more likely to be enacted by attractive, female aggressors whose actions are portrayed as justified and rewarded. Other studies have revealed that viewing these forms of aggression on television can increase indirect aggression in real life [Coyne et al., 2004], and that indirectly aggressive girls view significantly more programs containing indirect aggression than other girls do [Coyne and Archer, 2005]. Information processing theory can explain how aggression, both physical and indirect, can be learned after viewing either form of aggression on television [Huesmann, 1988]. Each individual has a variety of cognitive scripts that they use to explain and interpret their environment. These scripts cover a variety of topics, including appropriate aggressive behavior. When an individual views indirect (or physical) aggression on television, certain scripts relating to aggression are activated in the person’s memory, increasing the likelihood that the individual will behave aggressively in subsequent situations. Indirect/relational/social aggression is often portrayed on television to be justified, rewarded, and by attractive characters, all characteristics that have been shown to increase the likelihood that viewers will behave aggressively after viewing aggression on television [e.g., Coyne and Archer, 2004; Donnerstein et al., 1994]. Individuals do not learn how to behave aggressively solely from watching aggression on television. They can learn aggressive behavior from a variety of sources, including from parents, friends, and others in the social environment. One controversial defense for the levels of violence on television today is that this violence is a realistic mirror image of a violencefilled world. Critics of the levels of indirect, relational, and social aggression on television may assume such a stance, as these behaviors are (unlike violent behavior) very common in schools, homes, and the workplace. To discover if this perspective is accurate, the levels of these forms of aggression on television need to be compared with the levels of aggression found in the real world, where individuals may find that such activities are often not the justified or rewarded behaviors they view on television. Aims of the Present Study One major goal of the current study was to assess the frequency of items of relational, indirect, and social aggression in the school environment of adolescents, and to compare this with exposure to these forms of aggression on television. We have Aggr. Behav. DOI 10.1002/ab decided to examine adolescents, as this behavior becomes particularly frequent and harmful during pre- to early-adolescence [e.g., Björkqvist et al., 1992b]. We then used this information to assess whether the items that make up these constructs are perceived as occurring together to a greater extent than do items from different constructs [Archer, 2001; Björkqvist, 2001]. From this, we determined the existence of any differences in the constructs of relational, indirect, and social aggression. Another aim of the study was to examine how frequent and harmful the individual items subsumed in these categories of aggression are perceived to be. Often, researchers only report results for aggregate indirect or relational aggression, instead of examining the individual items such as gossiping or backbiting. It is important to know which individual items occur more frequently than others, and which items are perceived as more harmful so as to inform future research which aggressive behaviors are viewed differently than others. Based on previous research, we predicted that all forms of indirect/ relational/social aggression will be more common and hurtful for girls and that physical aggression will be more common and hurtful for boys [e.g., Galen and Underwood, 1997]. As participants were all in pre- to mid-adolescence, age differences were predicted to be minimal as indirect, relational, and social aggression are all very frequent at this stage of life [e.g., Crick et al., 1999]. METHOD Participants After data screening was completed (see below), 422 participants’ data were analyzed, with seven participants’ data being excluded. Two hundred and sixteen males (51.18%) and 191 females (45.26%) took part in the study (15 participants (3.55%) did not report their sex). Participant age ranged from 11 to 15 years, with the mean age being 12.79 years (SD 5 .90). Participants attended one of two average-sized high schools in North West England. Seventy-seven participants were from year 7 (sixth grade US equivalent), 156 were from year 8 (seventh grade US equivalent), and 170 were from year 9 (eighth grade US equivalent) (19 participants did not report their year). Measures The Indirect/Social/Relational Aggression scale (ISRA) was used to assess the frequency and Indirect, Relational, and Social Aggression 297 harmfulness of different forms of aggression. This measure was created by incorporating items from several scales commonly used by indirect, relational, and social aggression researchers. Items of indirect aggression were taken from the Direct and Indirect Aggression Scale [Björkqvist et al., 1992a]. This measure asks participants to rate each class member’s level of aggression on a Likert Scale; therefore, providing a multi-informant measure of an individual’s aggression. Relational aggression items were taken from a peer nomination measure of relational aggression [Crick and Grotpeter, 1995] and the Social Experience Questionnaire, a self-report measure of victimization of aggression [Crick and Grotpeter, 1996]. A few non-verbal items commonly used by social aggression researchers were taken from the Revised Social Experience Questionnaire, a derivation of the above scale [Galen and Underwood, 1997]. Items of physical and verbal aggression from the Aggression Questionnaire were also included [Buss and Perry, 1992]. These measures were chosen as they provide a fairly representative sample of the items used by researchers in this area. As there are many items that overlap for indirect, relational, and social aggression, these were difficult to place in clear, distinct, categories. However, based on conceptual groupings and a factor analysis (reported later), we decided to classify these items as indirect aggression (ten items), direct relational aggression (six items), and non-verbal social items (two items). There were also five items of physical aggression and five items of direct verbal aggression (see Table VI for a listing of the total 28 items). For Part 1, participants were required to circle how many times they heard about or witnessed each aggressive behavior in the past week on a scale ranging from 0 to 51.1 It should be noted that we were investigating how frequently various forms of aggression occur in a person’s social environment, rather than the more usual method of measuring individuals’ behavior. This methodology was used so that we could compare exposure to aggression in a participant’s social environment with exposure to aggression on television. Self-report measures that ask how frequently a person is an aggressor or victim would not capture the total exposure of an individual to these forms of aggression. Additionally, these measures have been criticized for not being accurate as many individuals are unwilling to report that they engage in any aggressive behavior 1 Originally, the scale ranged from 0 to 71. This was lowered to a 0 to 51 scale after pilot testing revealed that responses above 5 were nonexistent. [Björkqvist, 2001]. Part 2 of the ISRA required each participant to rate how harmful they felt each aggressive behavior would be if it actually happened to someone. Participants were asked to circle a number on a Likert scale, with 1 representing ‘‘they would NOT feel sad or hurt at all’’, 2 representing ‘‘they would not really feel sad or hurt, 3 representing ‘‘they would feel somewhat sad or hurt’’, and 4 representing ‘‘they would feel REALLY sad or hurt’’. Cronbach’s a for each scale in part 1 were: Indirect (.84), Direct relational (.79), Social (.50), Verbal (.81), and Physical (.75). Reliability was acceptable for each scale, except for social aggression, which was most likely a result of the lower number of items on this scale (Cortina, 1993). However, the total reliability for all aggression questions was high (.93). For part 2, Cronbach’s a were: Indirect (.84), Direct relational (.76), Social (.68), Verbal (.77), and Physical (.83). Again, reliability for social aggression was low, and the total reliability for this section was high (.94). The responses to the questionnaire were later compared to the results of a content analysis of aggression in British television [for full results see Coyne and Archer, 2004]. This analysis assessed the frequency of indirect, relational, social, physical, and verbal aggression in 228 hr of programming (402 episodes) identified as popular by participants in this study. Each participant was asked to list the five television programs they viewed most frequently, and the 29 most popular programs overall were included in the analysis. Each act of aggression was coded on the following variables: type of aggression, reward, punishment, justification, realism, relationship of aggressor and victim, aggressor and victim characteristics, genre, and country of origin, although these categories were not used in the present study. Procedure The questionnaire was administered in 17 coeducational classrooms (consisting of between 20 and 28 students per classroom). For part 1, each participant was given instructions to ‘‘Think about all the other members of your year and the way they treated each other in the past week. Now circle the number of times that you either heard about or watched the following behaviors taking place in the past week’’. Teachers went through the following sample question with their class and answered any questions if the students were in any way confused about how to complete the questionnaire. Aggr. Behav. DOI 10.1002/ab 298 Coyne et al. Sample 1: Frequency Hearing someone say something nice about someone else 0 1 2 3 4 51 After completing the sample question, participants were instructed to complete the questionnaire, by following the same procedure they did in the sample question. For part 2, participants were instructed to ‘‘Now think about how a person would feel if someone else did the following behaviors to them. Please circle how much you think that each of the behaviors would make a person feel sad or hurt.’’ Sample 2: Harmfulness Hearing someone say something nice about them 1——2——3——4 After completing the sample question, participants were instructed to complete the rest of the questions on the test. Finally, participants were asked to mark their sex, age, and year and how many hours of television they watched each day (scale of 0–8 hr).2 RESULTS Data Screening Several analyses were carried out to check for univariate outliers and missing data. The variables ‘‘Total Aggression’’ and ‘‘Total Hurt’’ were transformed into z scores. Any participant receiving a z score of over 3 was not used in the analysis. A total of seven participants’ data was not analyzed. An inspection of these participants revealed that they appeared not to take the questionnaire seriously (e.g., putting all 5s for how much aggression they see, or putting a ‘‘not hurtful at all’’ for all types of aggression). Assumptions of multi-collinearity, singularity, and normality were met. Factor Analysis A series of exploratory factor analyses were carried out to assess whether indirect, relational, and social aggression appeared as distinct factors. The factor analyses were only undertaken for the frequency scale.3 2 Ethical approval was obtained from the University’s ethics committee. Participants were treated in accordance with the Code of Conduct, Ethical Principles, and Guidelines as established by the British Psychological Society. 3 When combined, the factor analysis revealed two factors: one containing all the frequency items and one containing all the perceived harmfulness, thus the need to separate the two scales. Aggr. Behav. DOI 10.1002/ab All items. A principal components analysis with promax rotation was undertaken for all the items on the RISA. The suitability of the data for factor analysis was assessed prior to performing the analysis. An inspection of the correlation matrix revealed that the majority of factors had coefficients exceeding .30. The Kaiser–Meyer–Oklin value was .93, exceeding the critical value of .60 [Kaiser, 1970]. Bartlett’s test of sphericity was significant, w2 (378) 5 3,872.35, Po.001) suggesting that the data are suitable for factor analysis [Bartlett, 1954]. We decided to extract three factors based on conceptual groupings and examination of the scree plot. Altogether, this solution accounted for 49.45% of the variance. Table I shows that most items loaded strongly on only one factor, and three items (‘‘prank phone calls’’, ‘‘destroying relationships’’, and ‘‘rolling eyes’’) did not load on any factor. The first factor accounted for 34.97% of the variance and consisted of solely indirect, relational, and social aggression (e.g., ‘‘gossiping’’, ‘‘spreading rumors’’, ‘‘ignoring’’). The second component accounted for 8.71% of the variance and consisted of mainly the physical aggression items (e.g., ‘‘destroy property in front of someone’’, ‘‘biting’’, ‘‘scratching’’). There was one item of indirect aggression (getting others to dislike) and two items of direct relational aggression (‘‘not inviting to a party’’ and ‘‘threatening to end the friendship’’) that also loaded highly on this factor. The third factor contributed 5.77% to the variance and consisted of mainly verbal aggression items (e.g., ‘‘insulting’’, ‘‘yelling’’, ‘‘teasing’’). However, it should be noted that ‘‘hitting’’, the most common physical aggression item also loaded highly on this factor. This may be a result of the high frequency with which both hitting and verbal aggression are witnessed. The results of this analysis support the argument that there is another form of aggression that is distinct from physical and verbal aggression. Indirect, relational, and social items. As several items loaded on separate factors, a second factor analysis was conducted to assess whether there was any evidence for the distinction of the terms indirect, relational, and social aggression. A principal components analysis with promax rotation was undertaken on the 18 items of the ISRA scale involving relational, indirect, or social aggression. Again, the data were suitable for factor analysis as the majority of the items had a coefficient exceeding .30, a Kaiser–Meyer–Oklin value of .92 and a significant Bartlett’s test of sphericity, w2 (153) 5 2,403.48, Po.001). Indirect, Relational, and Social Aggression 299 TABLE I. Promax Rotation of the Three Factor Solution for all Frequency Items Item Component 1 (indirect, relational, and social items) Spreading rumors Break confidences Become friends with another Leaving people out on purpose Ignoring someone Gossiping Make fun of someone so it makes them look stupid Anonymous mean notes Make fun of clothes or personality behind a person’s back Getting others to help Make fun of clothes or personality to a person’s face Huddling Try to destroy someone else’s relationshipa Prank phone callsa Biting Destroy property behind back Destroy property in front of someone Not invite to party Scratching Get others to dislike Threaten to break off friendship Insulting Yelling Teasing Calling someone a mean name Give a dirty look Hitting Rolling eyesa % of variance explained Component 2 (physical items) Component 3 (verbal items) .77 .69 .69 .68 .67 .64 .56 .55 .51 .51 .50 .45 .79 .78 .77 .63 .62 .57 .55 .80 .80 .79 .75 .66 .57 34.97 8.71 5.77 Only loadings above .40 are displayed. a Item omitted. Examination of the scree plot indicated a threefactor solution, altogether accounting for 52.66% of the variance. Table II shows that most items loaded strongly on only one factor. The first factor accounted for 39.39% of the variance and consisted mainly of direct ways of hurting someone (e.g., ‘‘not invite to party’’, ‘‘threaten to end friendship’’, ‘‘sitting close together’’). The second component accounted for 7.35% of the variance and consisted of mainly indirect ways of hurting another (e.g., ‘‘breaking confidences’’, ‘‘spreading rumors’’, ‘‘gossiping’’). The third factor contributed 5.93% to the variance and consisted solely of two non-verbal items (‘‘dirty looks’’ and ‘‘rolling eyes’’). One item (prank phone calls) did not load on any factor and was omitted from the analysis. There was one ambiguous item (become friends with another as revenge) which loaded highly on both factors 1 and 2. The results of this analysis partially support the argument that items of indirect, relational, and social aggression are different, at least as far as their perceived occurrence is concerned. Differences in Frequency Table III shows the means and standard deviations for the frequency with which adolescents witness or hear about indirect, direct relational, social, verbal, and physical aggression.4 A mixed factorial ANOVA was conducted to assess whether these differences were significant and to examine the moderating factors of sex and year in school. Mauchly’s test of sphericity was significant, w2 (9) 5 243.55, df 5 9, Po.001; so Greenhouse– Geisser statistics will be reported. There was an 4 All ‘‘51’’ responses were coded as ‘‘5s’’, therefore making the range of means 0–5. It should be noted that because of this, answers of 51 may represent a number higher than 5, therefore deflating the mean. However, as revealed in pilot testing, typical answers did not exceed above 5, therefore, discrepancies would be minor if any. Aggr. Behav. DOI 10.1002/ab 300 Coyne et al. TABLE II. Promax Rotation of the Three Factor Solution for Indirect, Relational, and Social Items Component 1 (direct relational items) Item Get others to dislike Not invite to party Threaten to break off friendship Huddling Try to destroy someone else’s relationship Getting others to help Anonymous mean notes Spreading rumors Make fun of someone so it makes them look stupid Break confidences Gossiping Leaving people out on purpose Make fun of clothes or personality behind a person’s back Become friends with another Ignoring someone Prank phone callsa Give a dirty look Rolling eyes % of variance explained Component 2 (indirect items) Component 3 (social items) .85 .84 .77 .73 .60 .54 .43 .80 .75 .71 .66 .54 .46 .46 .45 .43 39.39 .77 .65 5.93 7.35 Only loadings above .40 are displayed. a Item omitted. TABLE III. Frequency and Harmfulness of Aggressive Behaviors Frequencya Type of aggression Indirect Direct relational Social Verbal Physical a Mean 1.68 1.42 2.46 2.84 1.34 SD 1.04 1.09 1.41 1.35 1.09 TABLE IV. Frequency and Perceived Harmfulness of Aggression for Boys and Girls Mean 2.89 2.94 2.13 2.74 2.95 .60 .67 .80 .69 .78 The higher the score the more frequent (Scale of 0–5). The higher the score the more harmful (Scale of 1–4). overall significant difference in the frequency of aggression reported by adolescents, F(3.14,1236.67) 5 203.74, Po.001. Simple effects analyses were conducted to assess where the differences occurred. All comparisons were significant (Po.001) except for between direct relational and physical aggression, t (418) 5 1.56, P 5 .12 (not all reported here because of the many comparisons). Adolescents reported witnessing or hearing about verbal aggression the most, then social aggression, indirect aggression, and finally about direct relational and physical aggression. The mixed ANOVA also revealed a significant main effect for year in school, F(2,394) 5 3.79, Po.05, but not for sex, F(1,394) 5 .83, P 5 .36. A significant interaction between year and sex was Girls Mean SD Mean SD Frequency Indirect Direct relational Social Verbal Physical 1.71 1.44 2.34 2.94 1.44 1.09 1.08 1.43 1.35 1.09 1.66 1.40 2.63 2.74 1.19 1.00 1.10 1.36 1.36 1.03 Perceived harmfulnessb Indirectc Direct relationalc Social Verbalc Physical 2.78 2.81 2.12 2.69 2.75 .63 .68 .81 .71 .60 3.06 3.12 2.17 2.84 2.96 .52 .59 .79 .64 .50 SD b Aggr. Behav. DOI 10.1002/ab Boys Harmfulnessb a a The higher the score the more frequent (Scale of 0–5). The higher the score the more harmful (Scale of 1–4). Comparison is significant. b c also not revealed, F(2,394) 5 1.72, P 5 .18. The means and standard deviations for frequency of different forms of aggression are shown in Table IV for sex and Table V for year in school of the participants. A MANOVA was conducted to more fully examine the age differences for the frequency of different forms of aggression. This analysis revealed a significant overall difference between year, Indirect, Relational, and Social Aggression 301 TABLE V. Frequency and Perceived Harmfulness of Aggression for Years 7, 8, and 9 Students Year 7 Year 8 Year 9 Mean SD Mean SD Mean SD Frequency Indirectb Direct relationalb Social Verbalb Physical 1.64 1.56 2.21 2.45 1.34 1.08 1.16 1.38 1.31 1.20 1.87 1.62 2.66 3.03 1.45 1.06 1.18 1.48 1.34 1.04 1.54 1.17 2.44 2.86 1.19 .99 .90 1.33 1.35 1.02 Perceived harmfulnessc Indirect Direct relational Socialb Verbalb Physical 3.01 3.06 2.37 3.00 3.05 .54 .59 .72 .57 .77 2.89 2.97 2.13 2.73 2.97 .60 .63 .78 .67 .73 2.88 2.90 2.06 2.68 2.94 .61 .70 .84 .73 .81 a a The higher the score the more frequent (Scale of 0–5). Comparison is significant. c The higher the score the more harmful (Scale of 1–4). b F(10,788) 5 3.51, Po.001; and significant main effects for indirect, F(2,397) 5 3.82, Po.05; direct relational, F(2,397) 5 7.93, Po.001; and verbal aggression, F(2,397) 5 5.04, Po.005. A series of Tukey’s post hoc tests (Po.05) revealed that Year 8 students reported being exposed to more of these forms of aggression than Year 7 and Year 9 students. Differences in Perceived Harm Table III shows the means and standard deviations for perceived harmfulness of overall types of aggression. A second mixed factorial ANOVA was conducted to assess whether these differences were significant and to again examine the moderating factors of sex and year in school. Mauchly’s test of sphericity was significant, w2 (9) 5 271.96, Po.001, so Greenhouse–Geisser statistics will again be reported. There was an overall significant difference in the perceived harmfulness of aggression reported by adolescents, F(2.98,1176.24) 5 187.61, Po.001. Simple effects analyses were undertaken to discover where these differences occurred. A series of paired samples t-tests revealed significant differences (Po.001) between all variables except between physical, direct relational, and indirect. Therefore, these variables were all perceived as the most harmful types of aggression, followed by verbal aggression and finally by social aggression. The mixed factorial ANOVA also revealed significant main effects for sex, F(1,394) 5 4.29, Po.05, and for year in school, F(2,394) 5 3.52, Po.05, but not for an interaction between the two, F(2,394) 5 2.13, P 5 .12. The means and standard deviations for perceived harmfulness of aggression are shown in Table IV for sex and Table V for year in school. Two separate MANOVAs were conducted to further examine these differences. An overall effect was revealed for sex, F(5,398) 5 8.60, Po.001. Girls perceived indirect, F(1,402) 5 26.50, Po.001; direct relational, F(1,402) 5 25.19, Po.001; and verbal aggression, F(1,402) 5 5.36, Po.05, as more harmful than boys did. There was no difference between girls and boys in the perceived harmfulness of social, F(1,402) 5 .55, P 5 .46 or physical aggression, F(1,402) 5 1.21, P 5 .27. A MANOVA also revealed a significant overall effect for year in school, F(1,397) 5 4.25, Po.05; and significant main effects for social, F(1,397) 5 4.25, Po.05; and verbal aggression, F(1,397) 5 6.33, Po.005. A series of Tukey’s post hoc tests (Po.05) revealed that in each case Year 7 students rated these forms of aggression as more harmful than Year 8 and Year 9 students. Individual Aggression Items Frequency. The frequency of individual aggression items was also examined. It should be noted that the following comparisons are only descriptive in nature; thus, these findings should be interpreted with caution. Table VI shows the means and standard deviations for each item. In particular, for indirect items, ‘‘gossiping’’ occurred most frequently, and ‘‘breaking confidences’’ occurred least frequently. For direct relational items, ‘‘making Aggr. Behav. DOI 10.1002/ab 302 Coyne et al. TABLE VI. Frequency and Harmfulness of Specific Aggressive Behaviors Frequencya Type of aggressive behavior Harmfulnessb Mean SD Mean SD 1.35 1.08 1.26 1.36 2.75 1.69 1.65 2.16 1.36 2.06 1.61 1.40 1.57 1.55 1.71 1.53 1.68 1.97 1.38 1.67 3.06 3.28 3.03 2.84 2.61 2.74 2.80 2.79 2.72 3.08 .94 .91 1.00 .94 .95 .91 .91 1.00 1.10 .87 1.21 1.34 2.49 1.05 1.15 1.31 1.49 1.52 1.76 1.55 1.46 1.59 2.93 2.64 3.20 2.86 2.87 3.13 .89 .98 .91 1.08 1.01 .99 3.23 .68 1.69 1.70 2.18 2.07 .88 .86 Verbal Calling a mean name Insulting Make fun of clothes or personality to a person’s face Teasing Yelling 3.43 2.74 2.25 2.86 2.95 1.75 1.83 1.81 1.84 1.72 2.70 2.76 3.12 2.75 2.37 .98 .92 .96 .99 .94 Physical Biting Destroy property behind their back Destroy property in front of someone Hitting or punching Scratching .68 .93 1.42 2.72 .94 1.36 1.34 1.60 1.91 1.39 2.86 3.00 3.13 3.19 2.62 1.09 .95 1.01 .96 1.04 Indirect Anonymous mean notes Break confidences Get other people to help Get others in the group to dislike someone Gossiping Ignoring someone Leaving people out on purpose Make fun of clothes or personality behind a person’s back Prank phone calls Spreading rumors Direct relational Become friends with another Huddling Make fun of someone so it makes them look stupid Not invite to party Threaten to break off friendship Try to destroy someone else’s relationship Social Give a dirty look Rolling eyes a The higher the score the more frequent (Scale of 0–5). The higher the score the more harmful (Scale of 1–4). b fun of someone to make them look stupid in front of the group’’ was the most frequent, while ‘‘not invite to party’’ was the least frequent item. The most frequent pure social aggression item was ‘‘giving someone a dirty look’’ and the least frequent item was ‘‘rolling eyes at someone’’. For verbal aggression, the most frequent item was ‘‘calling someone a mean name’’. The least frequent item was ‘‘making fun of clothes or personality to a person’s face’’, although it should be noted that all these types of verbal aggression were quite frequent when compared to other types of aggression. The most frequent item of physical aggression was ‘‘hitting or punching someone’’, and the least frequent item was ‘‘biting’’. Harmfulness. Specific aggressive behaviors were also examined to assess which were perceived Aggr. Behav. DOI 10.1002/ab as more harmful than others. Table VI shows the means and standard deviations for the harmfulness ratings. For indirect aggression, ‘‘breaking confidences’’ was perceived as the most harmful and ‘‘gossiping’’ was considered to be the least hurtful. These are the direct opposite of the frequency ratings. The most harmful direct relational aggression item was ‘‘making fun of others in front of the group so as to make someone feel stupid’’, while the least hurtful item was ‘‘huddling together to make someone feel excluded’’. For pure social aggression, ‘‘giving dirty looks’’ was perceived as the most hurtful and ‘‘rolling eyes’’ was considered the least hurtful. The most harmful verbal aggression items were perceived to be ‘‘making fun of clothes or personality to a person’s face’’ and the least hurtful was ‘‘being yelled at’’. Finally, for physical aggres- Indirect, Relational, and Social Aggression 303 sion, the most harmful item was perceived to be ‘‘hitting or punching’’, while the least hurtful was ‘‘scratching’’. Sex differences. A MANOVA was used to examine sex differences in specific aggressive items. Box’s test for equality of covariance was significant, F(406,261 899) 5 1.44, Po.001, so Pillai’s trace was again used. A main effect for sex was found, F(28,269) 5 2.48, Po.001. In particular, females reported significantly more gossiping, F(1,296) 5 7.96, Po.005, and dirty looks, F(1,296) 5 10.32, Po.001, than males. Males reported significantly more making fun of others to make them look stupid, F(1,206) 5 9.87, Po.005; and hitting, F(1,396) 5 5.93, Po.05. There were no significant sex differences in any other specific act of aggressive behavior. There were sex differences in a large number of the harmfulness ratings for specific aggressive items, in each case the girls rating the item as more harmful than the boys. However, these items were largely confined to indirect and direct relational aggression (e.g., ‘‘gossiping’’, ‘‘spreading rumors’’, ‘‘ignoring’’). The items on which the sexes did not differ were almost entirely physical, verbal, and social aggression (e.g., ‘‘hitting’’, ‘‘teasing’’, ‘‘giving dirty looks’’). Relationship Between Aggression on Television and in Real Life Television hours viewed. Participants viewed an average of 4.81 hr of television a day (33.67 hr a week). An independent samples t-test found that males and females did not differ in their reported hours of television watching, t (383) 5 .41, P>.69. A Pearson’s correlation found that as age increased, television watching decreased, r 5 .16, Po.001, although the overall correlation between the two was rather small. Total aggression. On average, respondents heard about or witnessed 50.20 separate acts of total aggression each week. For indirect, relational, and social aggression, participants reported that they were exposed to 33 acts of indirect aggression during a typical week in everyday life. Coyne and Archer [2004] found that indirect, relational, and social aggression were portrayed approximately 9.34 times per hour on television programs popular among British adolescents. In this study, participants reported they viewed an average of 4.81 hr of television a day, or 33.67 hr per week. This would result in the average adolescent viewing approximately 319.20 acts of indirect, relational, and social aggression each week on television. This was compared to the amount of aggression an adolescent is exposed to in the real world, which was found to be 33 acts of these forms of aggression. Based on these calculations, adolescents are exposed to nearly 10 times more acts of indirect, relational, and social aggression on television than they are in real life. DISCUSSION The primary goals of this investigation were threefold: to examine whether there is cause to distinguish between the terms indirect, relational, and social aggression, to confirm existing research on sex and age differences for frequency and perceived harmfulness of aggression, paying particular attention to the importance of individual items, and to compare exposure to indirect/relational/social forms of aggression in real life to exposure on television. We found that the perceived frequency of items of relational, indirect, and social aggression were statistically distinct from each other, although they also showed considerable overlap. All three categories of aggression contained items that may be placed into more than one of the categories, although it also appears that each of the terms contains items of aggression that are unique. Factor analysis showed three distinct factors, corresponding very closely to the three types of manipulative and often covert types of aggression. Thus, there is some support that the terms are distinct but overlapping concepts, at least as far as their perceived occurrence is concerned. When comparing these terms to physical and verbal aggression, however, it is clear that they are much more similar than they are different. The majority of indirect, relational, and social items were placed in a distinct factor when compared to verbal and physical aggression. As Björkqvist [2001] argued, all the terms are essentially describing the same types of behavior—a very manipulative and sneaky way of hurting others, particularly through the use of social groups and relationships. Indeed, indirect, relational, and social aggression researchers could decrease confusion and argumentation by creating one larger construct that encompasses all the items. We have argued that this term should be indirect aggression, as it has precedence over the other two, and is practically identical with relational aggression in both its form and strategic aims, except in the case of dyadic relationships where the Aggr. Behav. DOI 10.1002/ab 304 Coyne et al. aims and the acts involved are so different that this should be treated as a separate category [Archer and Coyne, 2005]. It is anyway clear that agreeing on a single term would reduce the confusion that is inherent in research using these three terms, and would allow researchers to draw on a wider range of relevant research and focus their activities. Overall, we found that verbal aggression was the type of aggression that was most frequently heard about or witnessed by adolescents, with social aggression (non-verbal) not far behind. Indirect aggression was found to be perceived as occurring more frequently than more direct forms of aggression aimed at harming relationships. This may be a result of the high perceived occurrence of gossiping as compared to other forms of indirect/relational aggression. Physical aggression was actually one of the least frequent types of aggression reported. These findings are consistent with research on both bullying and aggression. For instance, Eslea [2005] found that name-calling was the most frequent type of bullying for both children and adults, followed closely by threats, rumors, and ignoring the victim. Physical bullying was actually one of the least frequent forms of bullying found in schools. Verbal aggression was also found to be more common than physical aggression in preschool children [McCabe & Lipscomb, 1988]. This finding may be dependent on the environment of the individual, as self-reports in prisons revealed that physical aggression was actually the most frequent form of bullying [Ireland and Archer, 1996]. Overall, we found that participants perceived indirect and direct relational aggression as the most harmful, followed closely by physical aggression. Verbal and social aggression (non-verbal forms) were perceived to be the least harmful by adolescents. This may be because the effects of verbal and social aggression are not as long-lasting as other forms of indirect and direct relational aggression (e.g., destroying someone’s relationships). A recent study on bullying found that victims coped more easily with verbal aggression than with indirect aggression [Eslea, 2005]. Victims of indirect bullying were most likely to try to ignore the aggressor or get upset when bullied. Both of these forms of coping skills were very ineffective in getting the bullying to stop. Perhaps, this ineffectiveness of the coping styles in response to indirect and relational aggression is what makes it particularly distressing for adolescents. The results of this study support previous findings that females may be surrounded by as much aggression in the social environment as males when Aggr. Behav. DOI 10.1002/ab more covert forms of aggression are taken into account [e.g., Ireland and Archer, 1996; Owens et al., 2000]. This finding is inconsistent with the results from some studies using individual measures, which find that girls are more aggressive than boys in indirect forms, while boys are more physically aggressive than girls [e.g., Archer, 2004; Björkqvist et al., 1992b; Crick and Grotpeter, 1995; Crick et al., 1997; Fesbach, 1969]. However, it does support other findings showing similar levels of this type of aggression in the two sexes [e.g., Forrest et al., 2002; Hart et al., 1998; Linder et al., 2002; Rys and Bear, 1997]. One possible reason why our results did not confirm previous research was the methodology used. Since we were comparing these forms of aggression to those witnessed on television, we were interested in assessing an individual’s overall exposure to aggression, and not their direct experience with being an aggressor or victim. When examining aggression from this perspective, it appears that boys and girls are exposed to equal amounts of aggression in their social environment. We also found that girls tended to perceive aggression as being more harmful than boys did. In particular, girls were more likely to rate indirect, direct relational, and verbal aggression as more harmful. This finding supports the majority of other studies [Björkqvist et al., 1992b; Crick and Grotpeter, 1995; Galen and Underwood, 1997; Lagerspetz et al., 1988], as it suggests that girls value social relationships more than boys do, and are thus more hurt when these relationships are harmed or put into jeopardy. Although overall sex differences were not found, we found that girls reported observing more ‘‘gossiping’’ while boys reported more ‘‘hitting’’ when examining each individual item. Perhaps, previous findings that girls are more indirectly aggressive really stem from their high use of gossiping, rather than other less common but more harmful types of indirect/relational/social aggression. Campbell et al. [1997, p 169] have argued that gossiping among women should not even be classified as aggression as the intent to harm another person may not be there. They state that gossiping is about ‘‘forming rapport with another woman, and not aggressing’’. Although this may be true to some extent, especially when the victim is a member of the ingroup, we believe that gossiping can be hostile in intent, particularly when the aggressor knows that the victim is in an excluded outgroup and will somehow hear about the gossip. Gossiping can also taint other people’s view of the victim, and thus hinder their chances of having a good relationship in Indirect, Relational, and Social Aggression 305 the future. Perhaps, the term malicious gossiping should be introduced to distinguish it from gossip in general, which has other functions, such as advertising status and networking [Dunbar, 1996, 2004]. Malicious gossip can therefore be defined as ‘‘another person saying something mean about someone else behind his or her back. Gossip is only a form of aggression if the perpetrator knows that the victim’s feelings would be hurt if they heard about what was said.’’ Gossiping is likely to get back to the victim and therefore will hurt their feelings, if not their reputation. Although the person’s main intent may not be to harm the victim, it can still be defined as aggression as they know that the victim could possibly be harmed by the gossip. This type of intent is called ‘‘inconsiderate intent’’ and occurs when the aggressor knows that the action may cause distress or harm but accepts this and places his or her own interests above those of others [Potter et al., 1995]. We also found limited support for age differences in the use of aggression. Indirect, relational, and social aggression researchers generally agree that aggression goes through a developmental process [e.g., Björkqvist et al., 1992b; Crick et al., 1999; Underwood, 2003]. Early in life, children primarily use physical aggression to achieve what they desire. When verbal skills emerge, children can use this newfound ability to aggress against others. Indirect/ relational/social forms of aggression do not appear until preschool age, when peer relationships emerge on the scene. Even then, these forms of aggression are relatively primitive and are more likely to involve direct relational than other forms. When children develop the social intelligence to successfully manipulate the social circle for their gain, aggression becomes even more covert. Björkqvist et al. [1992b] stated that indirect aggression peaks at age 11 and begins to decline thereafter. Our results partially confirmed previous research concerning age differences. In particular, participants in Year 8 (aged 12–13) were more likely to report witnessing or hearing about indirect, direct relational, and verbal aggression than participants in Year 7 (aged 11–12) and Year 9 (aged 13–14). Indirect strategies of Year 7 students may not be fully developed, especially as this is their first year in high school and they are integrated with a large number of students with whom they are not familiar. By the time they reach Year 8, social groups may be fully established, and indirect and direct relational aggression may become particularly effective. The frequency of aggression reported dropped by Year 9. By this time, students may experience more social sanctions against using aggression on their peers, or perhaps the aggression has become so covert by this age that it is not witnessed or heard about by the rest of the Year. Again, these results should be taken with caution, as the methodology used may inflate the actual amount of aggression occurring, as more than one student may be reporting each episode. We found that adolescents are exposed to a great deal more indirect/relational/social aggression on television than they are exposed to in real life. They witness nearly 10 times the amount of this form of aggression while viewing their favorite television programs than they experience when interacting with their peers. Therefore, any claims that television is simply mirroring the level of indirect aggression in real life are unfounded. Because of the volume of this form of aggression on television, it is possible that television is influencing adolescents in their perceptions of indirect/relational/social aggression, more so than the aggression they are exposed to in school. Coyne et al. [2004] found that adolescents who viewed indirect aggression on television were more likely to be indirectly aggressive in real life than those who viewed no aggression. The information processing theory [Huesmann, 1988] would predict that viewing such a large amount of this form of aggression on television may reinforce aggressive scripts and teach adolescents that aggression used in social interactions is justified, rewarded, and normal. It should be noted, however, that participants in the current study only reported aggression that occurred at school or among friends. Thus, the frequency may be slightly higher when aggression in family relationships is included. Furthermore, although a fairly exhaustive list of indirect/relational/social aggression behaviors was included on the measure, there may be other items that we did not include. CONCLUSIONS Overall, we found that adolescents are exposed to a rather large frequency of indirect, relational, and social aggression during school. However, they are exposed to an even greater amount of aggression while viewing television each day. This study revealed some evidence for a distinction between the terms indirect, direct relational, and social aggression. Yet, we also found support for an integration of the terms, as they are more similar than distinct when compared to physical or verbal aggression. We have suggested that researchers agree on a system that acknowledges the similarities Aggr. Behav. DOI 10.1002/ab 306 Coyne et al. in the terms, to enable them to focus more on how to combat these hurtful forms of aggression, instead of debating definitions. ACKNOWLEDGMENTS We thank the head teachers and counsellors who helped with scheduling the data collection. REFERENCES Archer J. 2001. A strategic approach to aggression. Soc Dev 10: 267–271. Archer J. 2004. Sex differences in aggression in real-world settings: A meta-analytic review. Rev Gen Psychol 8:291–322. Archer J, Coyne SM. 2005. An integrated review of indirect, relational, and social aggression. Pers Soc Psychol Rev 9: 212–230. Bartlett MS. 1954. A note on the multiplying factors for various chi square approximations. J R Stat Soc 16:296–298. Björkqvist K. 2001. Different names, same issue. Soc Dev 10: 272–275. Björkqvist K, Lagerspetz K, Österman K. 1992a. Direct and indirect aggression scales DIAS. In Björkqvist K, Österman K. (eds): ‘‘1998. Pro Facultate (4) Scales for Research on Interpersonal Relations.’’ Åbo, Finland: Åbo Akademi University. Björkqvist K, Lagerspetz K, Kaukiainen A. 1992b. Do girls manipulate and boys fight? Developmental trends in regard to direct and indirect aggression. Aggr Behav 18:117–127. Björkqvist K, Österman K, Kaukiainen A. 1992c. The development of direct and indirect aggressive strategies in males and females. In Björkqvist K, Niemelä P (eds): ‘‘Of Mice and Women. Aspects of Female Aggression.’’ San Diego, CA: Academic Press, pp 51–64. Björkqvist K, Österman K, Lagerspetz K, Landau SF, Caprara G, Fraczek A. 2001. Aggression, victimization and sociometric status: Findings from Finland, Israel, Italy and Poland. In Rameriez JM, Richardson DS, (eds): ‘‘Cross-Cultural Approaches to Aggression and Reconciliation.’’ Huntington, NY: Nova Science Publishers Inc, pp 111–119. Buss A. 1961. ‘‘The Psychology of Aggression.’’ Oxford, England: Wiley & Sons, Inc. Buss A, Perry M. 1992. The aggression questionnaire. J Pers Soc Psychol 63:452–459. Cairns R, Cairns B, Neckerman H, Ferguson L, Gariepy J. 1989. Growth and aggression: 1. Childhood to early adolescence. Dev Psychol 25:320–330. Campbell A, Sapochnik M, Muncer S. 1997. Sex differences in aggression: Does social representation mediate form of aggression? Br J Soc Psychol 36:161–171. Cortina JM. 1993. What is coefficient alpha? An examination of theory and applications. J Appl Psychol 78:98–104. Coyne SM, Archer J. 2004. Indirect, relational, and social aggression in the media: A content analysis of British television programmes. Aggr Behav 30:254–271. Coyne SM, Archer J. 2005. The relationship between indirect and physical aggression on television and in real life. Soc Dev 14: 324–338. Coyne SM, Archer J, Eslea M. 2004. Cruel intentions on television and in real life: Can viewing indirect aggression increase viewers’ subsequent indirect aggression? J Exp Child Psychol 88:234–253. Aggr. Behav. DOI 10.1002/ab Craig W. 1998. The relationship among bullying, victimization, depression, anxiety, and aggression in elementary school children. Pers Individ Differ 24:123–130. Crick NR, Grotpeter J. 1995. Relational aggression, gender, and social–psychological adjustment. Child Dev 66:710–722. Crick NR, Grotpeter J. 1996. Children’s treatment by peers: Victims of relational and overt aggression. Dev Psychopath 8: 367–380. Crick NR, Casas J, Mosher M. 1997. Relational and overt aggression in preschool. Dev Psychol 33:579–588. Crick NR, Werner N, Casas J, O’Brien K, Nelson D, Grotpeter J, Markon K. 1999. ‘‘Childhood Aggression and Gender: A New Look at an Old Problem. Gender and Motivation. Nebraska Symposium on Motivation,’’ Vol. 45. Lincoln, NE: University of Nebraska Press, pp 75–141. Deveaux K, Daniels T. 2000. Children’s social cognitions: Physically and relationally aggressive strategies and children’s goals in peer conflict situations. Merrill-Palmer Quart, 46:672–692. Donnerstein E, Slaby RG, Eron LD. 1994. The mass media and youth aggression. In Eron LD, Gentry J, Schlegel P (eds): ‘‘Reason to Hope: A Psychosocial Perspective on Violence and Youth.’’ Washington, DC: American Psychological Association, pp 219–250. Dunbar RIM. 1996. ‘‘Grooming, Gossip and the Evolution of Language.’’ London: Faber. Dunbar RIM. 2004. Gossip in evolutionary context. Rev Gen Psychol 8:100–110. Eslea M. 2005. ‘‘School Bullying: Severity, Distress and Coping.’’ Preston, UK: Department of Psychology, University of Central Lancashire, unpublished manuscript. Fesbach N. 1969. Sex differences in children’s modes of aggressive responses toward outsiders. Merrill-Palmer Quart 15:249–258. Forrest S, Eatough V, Shevlin M. (March) 2002. Developing a measure of adult indirect aggression. Paper presented at the British Psychological Society Annual Conference, Blackpool, UK. Galen BR, Underwood MK. 1997. A developmental investigation of social aggression among children. Dev Psychol 33: 589–600. Green L, Richardson D, Lago T. 1996. How do friendship, indirect, and direct aggression relate? Aggr Behav 22:81–86. Hart C, Nelson D, Robinson C, Olsen S, McNeilly-Choque M. 1998. Overt and relational aggression in Russian nursery-school-age children: Parenting style and marital linkages. Dev Psychol 34: 687–697. Henington C, Hughes J, Cavell T, Thompson B. 1998. The role of relational aggression in identifying aggressive boys and girls. J Sch Psychol 36:57–477. Huesmann LR. 1988. An information processing model for the development of aggression. Aggr Behav 14:13–24. Ireland J, Archer J. 1996. Descriptive analysis of bullying in male and female adult prisoners. J Comp Appl Soc Psychol 6:35–47. Kaiser H. 1970. A second generation Little Jiffy. Psychometrika 35:401–415. Kaukiainen A, Salmivalli C, Björkqvist K, Österman K, Lahtinen A, Kostamo A, Lagerspetz K. 2001. Overt and covert aggression in work settings in relation to the subjective well-being of employees. Aggr Behav 27:360–371. Lagerspetz K, Björkqvist K, Peltonen T. 1988. Is indirect aggression typical of females? Gender differences in aggressiveness in 11to 12-year old children. Aggr Behav 14:403–414. Linder JR, Crick N, Collins WA. 2002. Relational aggression and victimization in young adults’ romantic relationships: Associa- Indirect, Relational, and Social Aggression 307 tions with perceptions of parent, peer, and romantic relationship quality. Soc Dev 11:69–86. McCabe A, Lipscomb T. 1988. Sex differences in children’s verbal aggression. Merrill-Palmer Quart, 34:389–401. Owens L, Shute R, Slee P. 2000. ‘‘Guess what I just heard!’’: Indirect aggression among teenage girls in Australia. Aggr Behav 26:7–83. Paquette JA, Underwood MK. 1999. Gender differences in young adolescents’ experiences of peer victimization: Social and physical aggression. Merrill-Palmer Quart 45:242–266. Potter JW, Vaughan MW, Warren R, Howley K, Land A, Hagemeyer JC. 1995. How real is the portrayal of aggression in television entertainment programming? J Broadcasting Electr Media 39:496–516. Richardson R, Green L. 1999. Social sanction and threat explanations of gender effects on direct and indirect aggression. Aggr Behav 25:425–434. Rys G, Bear G. 1997. Relational aggression and peer relations: Gender and developmental issues. Merrill-Palmer Quart 43: 87–106. Salmivalli C, Kaukiainen A, Lagerspetz K. 2000. Aggression and sociometric status among peers: Do gender and type of aggression matter? Scand J Psychol 41:17–24. Underwood MK. 2003. ‘‘Social Aggression among Girls.’’ New York: Guilford Press. Underwood MK, Galen BR, Paquette JA. 2001. Top ten challenges for understanding gender and aggression in children: Why can’t we all just get along? Soc Dev 10:248–266. Aggr. Behav. DOI 10.1002/ab
© Copyright 2026 Paperzz