Getting Precise and Pragmatic About the Assessment

AGGRESSIVE BEHAVIOR
Volume 37, pages 234–247 (2011)
Getting Precise and Pragmatic About the Assessment
of Bullying: The Development of the California Bullying
Victimization Scale
Erika D. Felix1!, Jill D. Sharkey1, Jennifer Greif Green2, Michael J. Furlong1, and Diane Tanigawa1
1
2
University of California, Santa Barbara, California
Boston University, Boston, Massachusetts
: : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : :
Accurate assessment of bullying is essential to intervention planning and evaluation. Limitations to many currently available selfreport measures of bullying victimization include a lack of psychometric information, use of the emotionally laden term ‘‘bullying’’
in definition-first approaches to self-report surveys, and not assessing all components of the definition of bullying (chronicity,
intentionality, and imbalance of power) in behavioral-based self-report methods. To address these limitations, we developed the
California Bullying Victimization Scale (CBVS), which is a self-report scale that measures the three-part definition of bullying
without the use of the term bully. We examined test–retest reliability and the concurrent and predictive validity of the CBVS across
students in Grades 5–12 in four central California schools. Concurrent validity was assessed by comparing the CBVS with a
common, definition-based bullying victimization measure. Predictive validity was examined through the co-administration of
measures of psychological well-being. Analysis by grade and gender are included. Results support the test–retest reliability of the
CBVS over a 2-week period. The CBVS was significantly, positively correlated with another bullying assessment and was related
in expected directions to measures of well-being. Implications for differentiating peer victimization and bullying victimization via
r 2011 Wiley-Liss, Inc.
self-report measures are discussed. Aggr. Behav. 37:234–247, 2011.
: : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : : :
Keywords: bullying; victimization; power imbalance; measurement; self-report; psychometrics
INTRODUCTION
Accurate assessment of bullying is essential to
intervention planning and evaluation [Furlong et al.,
2010]; however, there are long-standing concerns
about its measurement [Cornell et al., 2006]. Bullying
is recognized as a subset of peer victimization that is
intentional, chronic, and characterized by an imbalance of power between victim and aggressor [Olweus,
1993]. Researchers worldwide have long struggled to
measure bullying in ways that facilitate cross-national
comparisons and to accurately estimate prevalence
rates. Past efforts have produced equivocal results
with considerable differences of prevalence rates
across studies [Smith et al., 2002], which raises the
issue of whether rates of bullying differ dramatically
across samples or if differences reflect measurement
imprecision. Measurement concerns include: (a)
whether or not to provide an a priori definition of
bullying to respondents [Espelage and Swearer,
2003]; (b) variations in definitions and time frames
used; (c) whether to use self-report, peer nomination,
or teacher-report methods [Cornell et al., 2006;
r 2011 Wiley-Liss, Inc.
Solberg and Olweus, 2003]; and (d) if available
measures actually assess the subset of peer victimization that is intended to be captured by the scientific
definition of bullying [Greif and Furlong, 2006].
The need for a sophisticated bully victimization
assessment tool has prompted scholars to rely on
prominent existing measures for more advanced
purposes than originally intended. Olweus [1996]
developed one of the first and most widely used and
adapted measures. His measure, and similar bullying
assessment instruments, was developed to estimate
prevalence—examine base rates at the school level.
Grant sponsor: United States Office of Juvenile Justice and
Delinquency Prevention via George Washington University.
!Correspondence to: Erika D. Felix, Department of Counseling,
Clinical, and School Psychology, Gevirtz Graduate School of
Education, University of California, Santa Barbara, CA 93106-9490.
E-mail: [email protected]
Received 20 April 2010; Revised 16 September 2010; Accepted 13
January 2011
Published online 14 March 2011 in Wiley Online Library (wiley
onlinelibrary.com). DOI: 10.1002/ab.20389
California Bullying Victimization Scale 235
Scholars have adapted these measures from their
original purpose in order to examine individual
differences through methods of classifying children
by bullying experience and correlating antecedents
and consequences to this classification. Bully assessment tools are also needed to evaluate intervention
programs at the individual- vs. school-level [Greif
and Furlong, 2006]. It is only recently that scales
developed for epidemiological purposes have been
evaluated for the psychometrics needed for individual differences research [e.g., Kyriakides et al.,
2006; Lee and Cornell, 2010], but with limited,
unique samples. Thus, assessing the psychometrics of
self-report bullying victimization measures remains
crucial for research and applied practice to continue
to advance. In this article, we describe the development and psychometric properties of the California
Bullying Victimization Scale (CBVS). We begin by
reviewing the state of self-report bullying assessment,
different approaches within self-report, and the need
for further refinement of self-report assessment.
Self-Report Bullying Measurement Approaches
Self-report assessments are the most common
method to measure bullying victimization, in part
because they are easier and less costly for researchers
and educators to implement than other methods,
such as intensive behavioral observations of schoolyard interactions. Researchers have debated the
relative benefits of self-report vs. other methods.
Solberg and Olweus [2003] argued that self-report is
the best method for ascertaining prevalence estimates, which is information that educators and
policy makers often need. On the other hand,
Cornell and colleagues [Cornell et al., 2006; Lee
and Cornell, 2010] pointed out that many available
measures do not have adequate reliability and
validity. For example, Henry [2006] found that
self-reports of aggressive behavior lacked criterionrelated validity, whereas teacher- and peer-report
methods were significantly correlated to observations of aggressive behavior. However, research has
not demonstrated a relative lack of validity for selfreports of victimization, especially for indirect forms
of victimization that are not readily observable.
Thus, self-reports remain a viable way to assess the
prevalence of bullying victimization and further
research is clearly warranted.
Considering concerns about the reliability and
validity of bullying self-reports, there have been calls
to use other assessment procedures such as peer
nominations [e.g., Chan, 2006; Chan et al., 2005]
and behavioral observations [e.g., Cornell and
Brockenbrough, 2004; Craig et al., 2000; Hawkins
et al., 2001]. Studies using these methodologies have
provided valuable data to answer questions that
could not be addressed by self-report data alone.
However, there could be ethical and/or logistical
challenges with peer nominations and behavioral
observations that make it more difficult to obtain
research review board or school approval and
written guardian consent [Espelage and Swearer,
2003]. For example, in playground observations,
researchers face an ethical dilemma when they
witness victimization as it would be unethical to
observe a physical attack without intervening. Likewise with peer nominations, if parents do not consent
for their children to participate, researchers may not
collect peer nominations of their sociometric statuses. A single missing participant could affect the
validity of all classroom or grade-level reports.
Although researchers have successfully negotiated
these potential dilemmas to produce valuable research, these considerations may be limiting factors
in some schools, communities, and universities,
making self-reports a favorable alternative.
In fact, self-report has been the primary approach
used by researchers. Hence, it is critical to examine
the status and quality of bullying self-report
measures [see Furlong et al., 2010 for a review].
The self-report measures used by researchers generally either (a) provide a working definition of
bullying and ask a youth if they had experienced this
type of victimization or (b) present a list of
victimization-related behaviors and ask how often
the youth has experienced or committed them. We
will review both approaches.
Definition-based self-report strategy. Assessments of bullying and bullying victimization
often provide a definition of bullying to acquaint
students to the idea of bullying as defined by the
researchers, with the intent of establishing a shared
meaning of the bullying experience across all study
participants. Considerable effort has been devoted to
developing a consensus on how to define and
measure bullying [e.g., Arora, 1996; Naylor et al.,
2006; Smith et al., 2002]. Smith et al. [2002] point out
that the issue of definition is crucial for accurate
reporting of bullying prevalence cross-nationally and
that the word ‘‘bully’’ is not easy to translate. To
overcome terminology challenges, they used 25 stickfigure drawings depicting several types of aggressive
experiences to assess the words used to describe these
experiences across a 14-nation sample. They found
significant variation in the number of drawings
assigned to each term, demonstrating different
victimization scenarios implied by each term.
Aggr. Behav.
236 Felix et al.
Researchers have debated the merits of defining
bullying before asking students’ about their experiences. The definition of bullying has evolved over
the past 30 years to include a broad range of
victimization; hence, studies have varied in measurement practices. These practices have led to varying
prevalence estimates and consequently it is difficult
to evaluate the nature and extent of cross-sample
comparability. Also, studies have repeatedly shown
that different informants have different views of the
definition. Older youth have a more nuanced and
complex view of bullying than younger children
[Smith et al., 2002]. Similarly, teachers’ definitions of
bullying tend to correspond more to the three-part
definition of intentionality, repetition, and imbalance of power than students [Menesini et al., 2002].
In Europe, a workgroup reviewed self-report and
peer nomination bullying assessment methods in an
effort to improve bullying intervention [Ortega et al.,
2001]. In a comprehensive review, they assessed the
content, items, age ranges, and advantages and
disadvantages for both self-report and peer nomination methods to propose core questions for a general
survey questionnaire. They concluded that the ideal
time frame to explore is the last 3 months, and they
recommended using a definition, with cartoons to
illustrate examples of physical, verbal, and indirect
bullying. However, it is not clear the extent to which
these practices have been adopted.
Even if definitional consensus were possible,
asking a youth to label himself or herself as a victim
or a bully may provoke emotional reactions that
could influence victims or bullies to not endorse
experiences associated with the label [Cornell and
Brockenbrough, 2004; Greif and Furlong, 2006;
Hamby and Finkelhor, 2000]. One study found that
when students are provided with a definition of
bullying, and are repeatedly exposed to the term
‘‘bully,’’ they report significantly less bullying than
those not exposed to a definition or the word
‘‘bully’’ [Kert et al., 2010]. In this circumstance,
bullying prevalence would be underestimated and
intervention outcomes would be affected by imprecise measurement. Likewise, in studies of adult
sexual harassment, participants commonly endorse
the critical behavioral experiences associated with
the legal definition of sexual harassment, but at the
end of the questionnaire, when asked if they had
been ‘‘sexually harassed’’ many denied it, perhaps
not identifying with the label [Cortina et al., 1998;
Fitzgerald and Ormerod, 1991].
Others argue that using a definition-first strategy
that includes multiple forms of aggression [e.g.,
presenting a definition listing various types of
Aggr. Behav.
aggression and then asking the youth if he or she
has been bullied) may produce heterogeneous data
that mask trends and correlations among subtypes
of bullying experiences [Cornell et al., 2006].
A broad definition does not allow for assessing the
relative contribution of each form of bullying
victimization to psychosocial adjustment [Cornell
et al., 2006; Felix and McMahon, 2006]. Even if
more than one question about victimization is asked
following a bullying definition, it is unclear how well
students remember long, multipart definitions when
responding to a series of items. Smith et al. [2002]
point out that even if a student is initially given an
extended definition of bullying, the term ‘‘bullying’’
is used in most of the following questions, and
children may use their natural understanding of this
term in their culture, rather than the originally
presented definition. Menesini et al. [2002] noted
that students in their sample were able to take into
consideration repetition, intention, and imbalance of
power, but their measure used visual aides in the
form of cartoons, which most definition-first
approaches do not do. Given these concerns, some
researchers have adopted a behavior-based strategy.
Behavior-based self-report strategy. In a
behavior-based approach, specific bully-related behaviors are presented (e.g., hitting, threatening, or
spreading rumors) and youth are asked to specify if
they have committed or experienced them without
using the term bullying. The behavioral method
breaks down victimization into specific experiences
in order to avoid individual perceptions, stigma, or
bias associated with using the term ‘‘bullying’’ or
‘‘victim’’ in the measure itself, and to allow
researchers to examine the frequency of each type
of victimization. However, this approach does not
tend to assess for an imbalance of power, and thus
fighting between peers of equal strength, which is
considered to be aggression but not bullying, would
likely be included [Smith et al., 2002].
Behavioral strategies generally classify the group
with the highest level of victimization experiences as
‘‘victims’’ and those with the highest levels of
perpetration as ‘‘bullies’’ [Espelage and Swearer,
2003]. Some issues associated with this approach
are: (a) the criteria used to select extreme responders
(e.g., one standard deviation above the mean, less,
more) vary across studies [Solberg and Olweus,
2003]; (b) educators conducting school-based surveys are unlikely to be able to complete the complex
computations needed to classify students with
statistical methods; and (c) unless additional items
are coadministered, the behavioral method assesses
only one aspect of the definition of bullying, which is
California Bullying Victimization Scale 237
the repetitive nature of the experience. This neglects
intentionality and imbalance of power, which also
differentiate bullying from general peer victimization. Although it may be argued that if a child is
repeatedly victimized, there must be an imbalance of
power, as the child is unable to stop the victimization, this is not always the case. For example, two
boys of the same strength and social standing may
dislike each other and repeatedly fight, but this
would not traditionally be considered bullying.
Advantages of Self-Report Strategies
and Moving Forward
Self-reports address many complex issues of
understanding bullying behavior. First, self-report
procedures are efficient and can be conducted in
school, community, and laboratory settings with
minimal cost. Second, self-reports can assess the
diverse and important subtypes of bullying behavior, including direct, indirect, and relational
aggression. This includes behaviors that are not
readily observable by others. Third, they have the
potential to assess the perceived power imbalance
from the perspective of the bully, victim, or bullyvictim. Fourth, they do not rely on consent from
other participants (as in peer nomination procedures). Fifth, they assess the perspective of the
participant (both bully and victim), which is critical
when attempting to understand intentionality and
impacts on psychosocial functioning. Finally, selfreport can simultaneously assess and distinguish
between different forms of bullying behavior to
better understand differential impact.
Although there are advantages to using self-report,
there are also unresolved issues to be addressed in
order to move research and evaluation of prevention
programs forward. Bullying is a subset of peer
victimization [Björkvist et al., 1982] and a challenge
of bullying assessment methods is to distinguish
bullying from other types of peer victimization
including playful behavior [Cornell et al., 2006].
Indeed, some researchers have gone beyond the bully,
victim, bully-victim, and nonvictim classification to
explore the roles of all students in bullying encounters
[e.g., Salmivalli, 1998, 1999, 2010]. Salmivalli [1998]
articulated multiple participant roles, in addition to
bully and victim, which included the assistant to the
bully, the reinforcer, the defender, and the outsider.
As many have noted, friends or acquaintances can
engage in teasing and horseplay that may look like
bullying to an outside observer [Cornell et al., 2006;
Rigby, 2004]. Given various bully victimization roles,
it is critical to evaluate the importance of nuances in
types of peer victimization to accurately understand
the impact of these diverse experiences.
Research supports the important distinction
between the larger group of peer victims and the
subset of bully victims [You et al., 2008]. Thus, there
is a need to explore alternative strategies to assess
power imbalance, one of the three key elements of
bullying. Namely, youth who have experienced
repeated bullying have worse psychological health
than youth who have experienced peer victimization
that was not bullying. Thus, relying solely on the
repetitive nature of victimization may be inadequate
to truly understanding the bully experience and
research needs to implement and test methods of
assessing the power imbalance.
Lastly, researchers vary on defining chronicity.
Studies using a behavioral approach have identified
extreme responders to classify ‘‘bullies’’ or ‘‘victims’’
[Espelage and Swearer, 2003], which necessitates a
cumbersome statistical procedure. However, Solberg
and Olweus [2003] argued that using a definition of
bullying and the empirically derived frequency criteria
of ‘‘2–3 times per month’’ or more derives the best
estimate of bullying victimization based on its relation
with negative conditions such as depression. As there
are advantages and disadvantages to both definitionfirst and behavioral approaches, and there is a need for
identifying the psychometric properties of a self-report
bullying assessment specifically designed for individual
differences research, we developed the CBVS aiming
to address current needs in bullying assessment.
California Bullying Victimization Survey
The CBVS was developed as a self-report measure
of multiple forms of bullying victimization, and to
distinguish bullying from peer victimization, without
the use of a definition. The CBVS avoids the label
‘‘bully,’’ on the premise that this term may be
emotionally laden to respondents, and influence
victims or bullies not to endorse experiences associated with the label [Cornell and Brockenbrough,
2004; Greif and Furlong, 2006]. As one method to
differentiate bully victims from peer victims, we
specify in each question that the behavior must be
done on purpose in a mean and hurtful way.
Anecdotally, we observed in student interviews that
some children who initially endorsed a behavioral
description later stated that it was not done on
purpose in a mean or hurtful way. Thus, without
this specifier, prevalence rates may be overestimated.
The aggressor and victim may have different
opinions as the aggressor may deny that he or she
intended to hurt the other person or may minimize
Aggr. Behav.
238 Felix et al.
the harm done. We took the perspective of the
victims, as ultimately it is their appraisal of the
situation that will likely affect their well-being.1
Another way to differentiate bullying from peer
victimization is through the presence of a power
imbalance. Without using a definition, the CBVS
was designed to assess whether the reporter perceives a power imbalance between self and the
aggressor. We assess power imbalance in terms of
how popular, smart, and strong was the person who
did mean things on purpose to the respondent.
These power imbalance options are similar to those
in the Swearer Bullying Survey [Swearer, 2001].
An additional measurement consideration addressed by the CBVS is the time frame and
frequency scale. Given that the accuracy of recall
diminishes with time, the CBVS uses a past 30-day
time frame and the same frequency scale used in the
Olweus Questionnaire, which allows comparison
across studies using his measure. The Olweus
frequency scale classifies victims as those experiencing bullying 2–3 times a month or more, a cutoff
that is easy for schools to use and understand.
Study Purpose
The purpose of this study is to examine the
psychometric properties of the CBVS for use with
individual students to determine its functioning as a
new measure of bullying victimization. First we
examine item-level test–retest reliability of the CBVS
victimization items. We subsequently use the CBVS
to classify students as nonvictims, peer victims, or
bully victims and examine the test–retest classification
reliability of these categories. We next turn to
measure validity and compare the CBVS classification of bully victims to respondents who are classified
as bully victims using the ‘‘definition-first approach.’’
Finally, we examine the predictive validity of the
CBVS to determine the extent to which classification
on this measure is associated with theoretically
related constructs and measures of psychological
well-being. As there are gender differences in the type
of victimization girls and boys experience most
frequently [e.g., Crick and Grotpeter, 1995; Olweus,
1993], initial analysis was by gender. In addition,
given the developmental range covered in this study,
analyses were also separated by grade groupings (i.e.,
elementary, middle school, high school).
1
Research on sexual harassment notes a significant difference in
opinion between the perpetrator and victim on whether a behavior
constituted harassment and legally, courts uphold the view that it is
not the intent of the perpetrator that matters, but rather the effect on
the victim [Paludi, 1997].
Aggr. Behav.
METHOD
Preliminary Development of CBVS
In response to the need for improved self-report
assessments, as well as a request for help with a
school-wide screening by a local junior high school,
we created a bullying victimization survey that
served as the basis for the CBVS. This initial draft
of the survey was administered to 463 junior high
school students of whom 329 were in seventh grade
(71%) and 134 were in eighth grade (29%) in June
2005. The sample was 55% White, 26% Latino/a,
and 19% representing other ethnic groups, and was
evenly divided on gender (51.6% female). To further
develop the survey, we analyzed student responses to
items for any inconsistent responding and queried
students for qualitative feedback on item content.
We delete revised items to increase clarity and added
an item on sexual harassment for students in Grade 7
or higher, in recognition that it is a common form of
peer victimization starting around puberty [Felix and
McMahon, 2006, 2007]. Subsequently, our research
team thoroughly reviewed several drafts of the CBVS
for consensus on item content, wording, and layout.
To further refine the CBVS, focus groups were
subsequently conducted at junior high and elementary school levels to review a draft of the survey and
provide feedback on item wording and clarity. At
the junior high school level, we recruited two
classrooms at a midsize school with diverse socioeconomic status (37% disadvantaged) and primarily
European American (42%) and Latino/a American
(40%) ethnic background: an eighth-grade leadership class and a seventh-grade general science class.
At the elementary level, we selected the single fifth/
sixth-grade classroom at a small school that serves
primarily Latino/a American (84%) and socioeconomically disadvantaged youth (74%). Consent
forms were sent home to parents at both schools
with over 90% positive consent across classrooms.
All students present on the day of the focus group
participated for one class period, which was 50 min.
More females than males participated, and the
groups were roughly evenly divided between grades,
with the exception of a lower number of sixth
graders. One of the principal investigators and
a graduate student research assistant conducted
each focus group. Students completed an item-byitem review of the CBVS and were asked about the
clarity of instructions and item wording. The
research assistant documented feedback on each
item and notes on each focus group were reviewed
by the research team and common themes were
identified. For example, students questioned the
California Bullying Victimization Scale 239
term ‘‘washroom’’ and suggested ‘‘bathroom’’ instead. The survey wording was changed where there
was consistent feedback or a consensus between
researchers, and the research team approved a final
version.
In October 2006, two focus groups were conducted with a convenience sample of high school
students in their elective class to review the wording
of the survey to make it appropriate for an older
student population. All students present for that
class on the day of the focus group participated. The
student population for the school is 53% Latino/a,
42% Caucasian, and the remaining is a mix of other
ethnicities. Approximately 27% of students were
considered socioeconomically disadvantaged and
38% were English Learners. One of the principal
investigators and a graduate student research
assistant conducted each focus group. Students were
led on an item-by-item review of the CBVS and
asked if the instructions and item wording were
understandable. No wording changes were suggested for the items assessing victimization.
administration. For the K-8 school and the elementary school, all students who initially participated
and who were present at school on the day of the
second administration, retook the questionnaire.
For the junior high, one class period was randomly
selected for each teacher to offer the Time 2
questionnaire. At Time 2, there were 43% boys,
33% fifth graders, 27% sixth graders, 20% seventh
graders, and 20% eighth graders. The ethnic
composition was 46% White, 38% Hispanic/
Latino(a), and 16% other or mixed ethnicity.
Sample 2. In study 2, we extended our descriptive study and exploration of the validity of the CBVS
to a high school sample. One high school in the central
coast region participated, and a total of 354 students
provided valid surveys, representing 14% of the total
student population. Over half were female (53%). For
grade representation, there were 39% in ninth grade,
22% in tenth grade, 22% in eleventh grade, and 17%
in twelfth grade. The ethnic composition was 54%
White, 34% Hispanic/Latino(a), and 12% representing other or mixed ethnicities.
Participants
Measures
Criteria for retention in the study. We
reviewed the data to find cases that had such high
levels of missing data that it was not acceptable to
retain them in the study. Using the following criteria,
we maintained 92% of all participants in the final
dataset: (a) no more than five items missing from the
validity scales and (b) at least one victimization item
completed. Although the complete analysis required
that the youth complete all victimization items, we
retained cases with incomplete victimization responses for the item-by-item test–retest analysis.
For this reason, the number of cases varies in the
analyses shown in the following sections.
Sample 1. Three schools in the central coast
region of California participated in the survey. One
school was a junior high school, one was a K-8
school, and one was a K-6 elementary school.
A total of 330 students had valid responses: 46%
boys, 14% fifth graders, 12% sixth graders, 40%
seventh graders, and 34% eighth graders. The ethnic
composition of the students was 51% White, 29%
Hispanic/Latino(a), and 20% other or mixed
ethnicity. Institutional Review Board concerns for
protection of human subjects prevented us from
gathering more detailed ethnicity data for minority
students given the low numbers of students of
alternate ethnic groups.
We readministered the survey to a subsample
(n 5 131) of the students 2 weeks from the original
A single questionnaire was created and titled, My
Experiences with Classmates at School. After brief
instructions, the questionnaire consisted of the
following scales in the order described.
California Bully Victimization Sale. The final
version of the CBVS includes items asking about six
(elementary version) to seven (secondary version)
forms of victimization that respondents may have
experienced at school: been teased or called names by
another student; rumors spread or gossip behind
someone’s back; left out of a group or ignored; hit,
pushed, or physically hurt; been threatened; had
your things stolen or damaged; or had sexual
comments or gestures directed at them (this question
is only included in the secondary school versions).2
Students are asked to rate the frequency of each of
these experiences on a five-point scale (0 5 Never,
1 5 once in the past month, 2 5 2 or 3 times in the past
2
For Study 2, we also piloted a question on cyber-victimization that
was not originally included in Study 1 with the middle school
students. We found 11% of the high school students we sampled
reported some cyber-victimization. We decided not to include that
one item in this study because (a) it was only in Study 2, whereas
sexual harassment was assessed in both studies (Grade 7 or higher),
and (b) it seems to be more of a means of victimization than a type,
in our estimation. For example, texting can be considered akin to
passing mean notes; threatening a fight via a social network sites is
similar to threatening via ‘‘friends’’ or other associates. Other
research has supported that cyber-bullying is more of a modality
than a distinct type [e.g., Varjas et al., 2009].
Aggr. Behav.
240 Felix et al.
month, 3 5 about once a week, and 4 5 several times a
week). In the next question, respondents are asked to
indicate if these behaviors were intentional and done
in a mean way. They select from among the
following responses in reference to the previously
rated victimization experiences broadly: They were
almost never mean ( just joking), they were sometimes
mean, they were almost always mean. Next, the CBVS
assesses power imbalance through a series of items
asking students to compare themselves to the ‘‘main
person who did these things to you.’’ Students rated
responded to a three-point scale (less than me, same
as me, more than me) on how popular, smart in
schoolwork, and physically strong the other person is
in comparison to themselves. These choices are
similar to the ones Swearer [2001] used in her survey.
The CBVS includes several other questions not used
in this study that are designed to guide intervention
planning including types of bullying witnessed (as a
bystander), information about students doing the
bullying, where on the school campus bullying
occurs, when during the school day it is most
frequent, and who students talk with about bullying.
Swearer Bullying Survey. The CBVS was
compared with an item from the Swearer [2001]
Bullying Survey that assessed bullying by providing
a definition and asking students how frequently they
have been victimized. The definition states: ‘‘Bullying
happens when someone hurts or scares another
person on purpose and the person being bullied has
a hard time defending himself or herself. Usually,
bullying happens over and over.’’ The following are
listed as possible examples of bullying behavior:
punching, shoving and other acts that hurt people
physically; spreading bad rumors about people;
keeping certain people out of a ‘‘group’’; teasing
people in a mean way; and getting certain people to
‘‘gang up’’ on others. Students are asked to indicate
if they were bullied this month and if yes, how often
(i.e., once in the past month, 2– 3 times in the past
month, once a week, several times a week).
Students’ Life Satisfaction Scale (SLSS). This
seven-item measure uses a six-point Likert scale
(strongly disagree to strongly agree) to assess overall
well-being (e.g., ‘‘My life is going well’’ and ‘‘My life is
just right’’) for students ages 8–18 years old. According
to prior research, internal consistency ranges between
.73 and .86 [Huebner et al., 2005] and test–retest
reliability is .76 across one to two weeks [Terry and
Huebner, 1995]. Correlations of the SLSS with other
life satisfaction scales meet expectations [Huebner,
1991], and studies support its construct, discriminant,
and predictive validity [Huebner et al., 2005]. For this
study, the a coefficient was .88.
Aggr. Behav.
School Connectedness Scale (SCS). The
SCS measures the bond felt by students toward their
school and the quality of the relationship between
students and teachers [McNeely, 2005]. Responses
are measured using a five-point Likert scale (strongly
disagree to strongly agree). This scale was constructed out of items originally included in the
National Longitudinal Study of Adolescent Health.
McNeely [2005] noted that three versions of the SCS
have been used from the NLSAH Study. The version
used in this study is the one employed by McMeely
et al. [2002], and administered in the Resilience
Youth Development Module of the California
Healthy Kids Survey (see WestEd; www.wested.
org/hks). An a of .81 was obtained in this study.
Children’s Hope Scale (CHS). The six-item
CHS is designed for children between the ages of 7
and 15 years. The CHS measures two aspects of
hope—the cognitive capacity to formulate plans to
achieve set goals (three items; e.g., ‘‘I can think of
many ways to get the things in life that are most
important to me’’), and self-efficacy, the belief that
one can achieve set goals through effort (three items;
e.g., ‘‘I think I am doing well’’). Children respond to
the items using a six-point scale (1 5 none of the time
to 6 5 all of the time). Both the internal consistency
and the test–retest reliability are greater than .70
[Snyder, 2005]. The CHS possesses strong concurrent
validity and acceptable predictive and discriminant
validity [Snyder, 2005]. The a for this study was .88.
Procedures
Sample 1. Schools participated in the survey in
May and June of 2006 after obtaining Institutional
Review Board approval. At the junior high school,
two social studies teachers agreed to administer the
survey to their students in multiple classes. At the
K-8 and elementary schools, all fifth- and sixthgrade students were given the opportunity to
participate. Teachers were provided with detailed
written instructions for administering the survey by
the research team. Teachers administered the survey
in their classrooms to students with parental consent
and student assent. Students were not asked to
provide their names; rather, random numbers were
used to protect their identity. For test–retest
reliability analysis, students received an envelope
with two surveys matched by their random identification number. Students wrote their name on the
envelope and approximately 2 weeks later, teachers
readministered the survey (retest subsample). Students turned in the envelopes with the matched
surveys and the envelopes were destroyed.
California Bullying Victimization Scale 241
Sample 2. In November 2006, teachers administered the survey in a paper-and-pencil format
during one class period to all students in the high
school who provided parental consent and student
assent. A detailed instruction sheet was provided for
teachers to administer the survey.
RESULTS
Rates of Peer Victimization
Descriptive statistics were calculated to determine
the percentage of boys and girls at each school level
(elementary, junior high, high school) who experienced each type of victimization with the frequency
criteria set at 2–3 times per month or more. Chisquare tests of significance revealed if rates were
different by gender. Results indicate that peer
victimization is a common experience at school
(Table I). Teasing was the most frequent form of
victimization reported by male and female students
across grade levels. Females reported higher rates of
victimization through rumors and social exclusion,
as compared with males. Males in Grades 7–12
reported that they were hit significantly more often
than females, although the opposite trend was found
in Grades 5 and 6. In general, there was a decline in
frequency of reported victimization from elementary
to high school.
Students were also classified as nonvictims, peer
victims, and bullied victims. Nonvictims were
students who reported no victimization experiences
on the CBVS. Peer victims reported at least one
victimization experience of any frequency, but no
power imbalance. Bully victims were students who
reported at least one type of victimization at least
2–3 times per month, reported that this victimization
was intentional at least some of the time, and
reported at least one form of power imbalance in
relation to the main person bullying them (Table II).
A hierarchical log-linear analysis with backward
stepwise model selection was conducted with SPSS
18.0 to test the higher-order relations between the
three classification variables of gender, age, and
victimization status. In the backwards elimination
steps, the first interaction eliminated was for gender
by grade, w2 5 0.71, df 5 2, P 5 .70, followed by the
three-way interaction, w2 5 4.64, df 5 6, P 5 .59, and
finally the gender by victimization interaction,
w2 5 4.35, df 5 2, P 5 .11. There was a remaining
significant interaction for grade by victimization,
w2 5 163.41, df 5 4, Po.001. The percentages of
students categorized as peer and bullied victims
declined with age; this decrease was most pronounced for the general class of peer victims, which
decreased from 45.3% and 52.2% among elementary school and junior high school students,
respectively, which compared with only 11.3%
reported by high school students. Almost threefourths of high schools students (73.4%) were in the
nonvictim group, compared with 28.2% of junior
high and 31.0% of elementary school students. The
decline in bullied victims was smaller across the
grade levels: elementary school (23.8%), junior high
school (19.6%), and high school (15.3%).
Test–Retest Stability
Two-week stability of the CBVS was evaluated to
determine test–retest reliability in a subsample of
students (n 5 131). First, as one test of response
stability, a total victimization score was calculated
as a sum of the six core victimization items (all but
sexual harassment). Correlations between the total
victimiation scores at time 1 and time 2 indicated a
high degree of agreement across points in time
TABLE I. Item-Level Descriptive Statistics of Victimization Experienced 2–3 Times or More per Month by Males (M) and Females (F)
Grade
5–6
7–8
9–12
M (n 5 36) (%)
F (n 5 48) (%)
M (n 5 114) (%)
F (n 5 130) (%)
M (n 5 167) (%)
F (n 5 187) (%)
22.2
16.7
8.3
8.3
13.9
11.1
38.3
25.0
37.5!!
18.8
14.6
12.5s
a
a
26.3
9.6
7.0
14.9
14.0
8.8
20.2
26.9
19.2!
16.9!
6.2!
8.5
9.3
18.5
18.0
9.6
6.0
12.0
4.8
4.2
9.0
14.4
13.9
11.2
4.8
3.2
2.1
12.3
Teased
Rumors
Ignored
Hit
Threatened
Property
Sexual comments
!Po.05; !!Po.01 (w2).
a
Not asked of elementary school participants.
Aggr. Behav.
242 Felix et al.
TABLE II. Percentages of Males (M) and Females (F) by Grade Level in Each Victimization Category at Time 1
Grades 5–6
Grades 7–8
Grades 9–12
Victim group
M (n 5 36) (%)
F (n 5 48) (%)
M (n 5 114) (%)
F (n 5 130) (%)
M (n 5 167) (%)
F (n 5 187) (%)
Not a victim
Peer victim
Bullied victim
39
39
22
25
50
25
26
58
16
30
47
23
74
14
12
73
9
18
TABLE III. Test–Retest Reliability: Kappa Agreement
Between Victimization Items (2–3 " /month or more) at Time 1
and Time 2 (after 2 Weeks) for Grades 5–8 (n 5 131)
Scale
Teased
Rumors
Ignored
Hit
Threatened
Property
Sexual comments
Time 1
k
.582!!!
.510!!!
.553!!!
.619!!!
.636!!!
.620!!!
.461!!
!!Po.01; !!!Po.001.
(r 5 .80 for Grades 5–6, r 5 .83 for Grades 7–8, for
both Po.001). Next, Cohen’s kappa coefficient was
examined for each item (Table III). For individual
types of victimization, Cohen’s ks ranged from .46
to .64, and were all significant, indicating that
agreement exceeds chance levels across victimization
experiences. As a final analysis of test–retest
stability, we examined the consistency in classifications of students as nonbullied and bullied across
two points in time (percent agreement 5 89.6,
k 5 .71). The classification table is presented in
Table IV. The majority of students (79%) were
classified as nonbullied at both points in time and
13% of students were classified as bullied at both
assessments. A total of 8% of youth reports
indicated a change of status with two thirds of these
youth changing from the bullied group at time 1 to
the nonbullied group at time 2.
Concurrent Validity
Evidence for the concurrent validity of the CBVS
was evaluated in comparison to a ‘‘definition-first’’
approach assessing bullying using the Swearer
Survey [Swearer, 2001; Table V]. The rates of
students classified as being bullied were relatively
similar in the definition-first measure (20.2% of
fifth/sixth graders, 17.5% of seventh/eighth graders)
and the CBVS (23.8% of fifth/sixth graders, 20.0%
of seventh/eighth graders). However, there were
substantial differences in exactly which students
were identified as being bullied by the two measures
Aggr. Behav.
TABLE IV. Reliability Analysis: Test–Retest Reliability of
CBVS Bullied Victimization Classification (n 5 131)
Time 2 (2 weeks later)
Not bullied
Bullied
103
4
7
17
Not Bullied
Bullied
Percent agreement: 89.6%; k: .71; w2: 65.6, Po.001.
TABLE V. Concurrent Validity: Comparison of Bullied
Victimization Classification Using CBVS Versus
Definition-First Strategy
CBVS classification
Definition-first
bully
Grades 5–6 (n 5 84)
Grades 7–8 (n 5 245)
item
classification
Not bullied
(%)
Bullied
(%)
Not bullied
(%)
Bullied
(%)
Not Bullied
Bullied
66.7
9.5
13.1
10.7
73.5
6.5
9.0
11.0
Note. Grades 5–6: Although there was a 77.4% agreement rate
between the two measures, there was only 24% concordance about
who experienced bullying; k 5 .343; w2 5 9.97, Po.01. Grades 7–8:
Although there was an 84.5% agreement rate between the two
measures, there was only 29% concordance about who experienced
bullying; k 5 .492; w2 5 59.69, Po.001.
(k 5 .34 for fifth/sixth graders, k 5 .49 for seventh/
eighth graders). This indicates that the different
measurement strategies significantly influenced classification status of individual students (i.e., they
identified somewhat different students).
Predictive Validity
The predictive validity of the CBVS was analyzed
per grade-level grouping by examining the relation
between victimization experiences and measures of
life satisfaction, school connectedness, and hope
(Table VI). The total victimization score had a
moderately negative relationship (r 5 !.14 to !.50)
with each of these indicators across age groups,
which were statistically significant in eight out of
nine comparisons.
California Bullying Victimization Scale 243
Analysis of variance of victimization classification
with measures of life satisfaction, school connectedness, and hope indicated a significant decrease in
positive functioning among students experiencing
peer victimization and bullying (Table VII). Students who were specifically classified as bullied
victims by the CBVS had significantly lower scores
on these indicators of positive functioning than
students who were peer victims but did not meet
criteria to be classified as bullied. The association of
victimization and positive functioning were most
pronounced for junior high and high school
students. Life satisfaction and school connectedness
seemed to suffer, in particular, among students who
were classified as peer victims and bullied victims.
Power Difference and Victimization Frequency
When applying the theoretical definition of bullying
to assign groups, there is a possible confound
between frequency of victimization and reporting a
power differential. Although our objective was to
determine whether strictly defined bullied victims
differed from other types of peer victims, we
conducted a contingency table analysis to determine
the level of association between power differential
and frequency of victimization. Results are displayed in Table VIII. Although there was a
significant relation between frequency of victimization experience and endorsement of a power
TABLE VI. Validity Coefficients of Total Victimization
Score (range 0–24) and Well-being Measures
Life satisfaction
School connectedness
Hope
7–8
9–12
!.50!!!
!.37!!
!.41!!
!.29!!
!.25!!
!.34!!
!.14!!
!!!Po.001; !!Po.01; one-tailed Pearson’s correlation.
Despite the many measures that have been
developed to evaluate bullying, assessment continues to need improvement in this field of research
[Cornell et al., 2006; Lee and Cornell, 2010]. This
study evaluated the psychometric properties and
validity of a new instrument, the CBVS, which was
designed to address some of the weaknesses in
existing measures of bullying. In particular, the
CBVS differentiates bullying from other forms of
peer victimization, a distinction that is rarely studied
[Hunter et al., 2007; Schäfer et al., 2002], yet
important for identifying students with the most
negative peer experiences. The CBVS specifically
measures the hallmark characteristics of bullying
(intentional, repeated, power differential) to make
this differentiation, while aiming to increase the
accuracy of classification of peer victims and bullied
victims. Several findings from this study indicate
that the CBVS demonstrates strong reliability and
TABLE VIII. Victimization Total Score (range 0–24) and
Percent with a Power Differential Endorsement
Victimization score
5–6
!.17
!.29!!
DISCUSSION
Power differential
Grade
Well-being measures
differential, t 5 7.53, df 5 326, Po.05, practically,
there were several students who reported frequent
victimization yet did not endorse a power differential, suggesting that assessing a power differential
can more accurately identify bullied victims.
Percent
n
0
34.7
52.3
75.0
25.0
29.0
94
170
44
16
4
328
0
1–6
7–12
13–18
19–24
Total
TABLE VII. Validity of Bully Victimization Classification for Victimization Group by Grade Level
Grades 5–6
Not a victim (N)
Peer victim (P)
Bullied victim (B)
F
df
Tukey HSD
Grades 7–8
Grades 9–12
LSS
SCS
CHS
LSS
SCS
CHS
LSS
SCS
CHS
3.76 (0.9)
3.63 (1.0)
2.92 (1.2)
4.40!
2, 77
BoP, N
2.88 (0.9)
2.97 (0.7)
2.68 (0.5)
1.23
2, 77
B5P5N
3.69 (0.7)
3.48 (0.9)
3.03 (1.1)
3.51!
2, 77
BoN
4.19 (0.8)
3.55 (1.0)
3.06 (1.1)
19.01!!!
2, 236
BoPoN
3.14 (0.7)
2.96 (0.6)
2.34 (0.8)
23.01!!!
2, 236
BoP 5 N
3.79 (0.9)
3.53 (1.1)
3.08 (1.1)
6.89!!
2, 236
BoP 5 N
3.64 (1.0)
3.42 (1.1)
3.08 (1.1)
8.62!!!
2, 348
BoN
2.86 (0.8)
2.65 (0.9)
2.29 (0.9)
13.29!!!
2, 348
BoN
3.56 (1.0)
3.44 (1.0)
3.13 (1.2)
5.10!!
2, 348
BoN
Note: LSS 5 Life Satisfaction Scale, range 0–5; SCS 5 School Connectedness Scale, range 0–4; CHS 5 Children’s Hope Scale, range 5 0–5.
Standard deviations in parentheses.
!!Po.01; !!!Po.001.
Aggr. Behav.
244 Felix et al.
validity to evaluate bullying victimization at the
individual level.
First, CBVS prevalence estimates had a similar
pattern to other studies that report age-related
decreases in rates of bully victimization, as youth
transition from junior high to high school [Nansel
et al., 2001; Solberg et al., 2007]. The CBVS
additionally showed gender-related differences in
the type of bullying experienced that are similar to
previous research, with males reporting higher rates
of physical victimization and females reporting
higher rates of relational victimization [Crick and
Grotpeter, 1995; Rivers and Smith, 1994].
Second, the CBVS had good test–retest reliability.
Report stability is a key indicator of effective bullying
evaluation as bullying, by definition, occurs repeatedly. The CBVS demonstrates good reliability over a
2-week period for the total scale score, each form of
victimization, and classification of students as bully
victims. It is notable that students who reported bully
victimization consistently across the two assessments
had lower scores on indicators of well-being than non
victims or unstable bullied victims. This suggests that
consistency across test–retest conditions is not only a
methodological issue, but may also indicate the
development of stable identification as a bullied
victim, which is associated with poor psychosocial
outcomes [Rosen et al., 2007].
Third, responses to the CBVS are associated with
indicators of well-being. Students who reported
higher CBVS scores reported lower life satisfaction,
school connectedness, and hope, indicating that the
CBVS detects students who are most at-risk for poor
psychosocial development at school. Particularly
striking is our finding that the group of students who
were bullied had lower scores on positive indicators
than students who reported more general experiences of peer victimization. This result is consistent
with Hunter et al. [2007] who found when they
categorized bullied youth separately from other peer
victims, those who were bullied were at much greater
risk for depressive symptomatology. Although few
studies have isolated these groups and evaluated
differential outcomes, students who specifically meet
criteria for the definition of bullying experience
significantly more difficulty than those who report
more general peer victimization. In addition, we
found that assessing for the power differential
helped in the identification of bullied victims than
when examining frequency of victimization alone.
Although CBVS prevalence rates were similar to
those derived from a definition-first measure that
was coadministered in this study, the two measures
identified somewhat different sets of students as
Aggr. Behav.
having been bullied. The lack of concordance
between the two measures indicates that the way
self-report surveys are structured fundamentally
impacts which students will identify themselves as
having been bullied. The absence of the word
‘‘bully’’ from the CBVS may have made questions
easier to endorse for students who had been
victimized. However, the requirement that students
explicitly endorse power differential may have had
the contrary effect of limiting respondents who did
not perceive a power difference or did not identify
the particular power difference that they experienced
among the list provided by the CBVS. Our choice of
what qualities to assess as a power differential
represented only a few of potentially many sources,
and was guided by previous bullying surveys.
‘‘Smart’’ was included as one source, as some prior
research indicated that victims have lower selfconcept in terms of intelligence [Salmivalli, 1998].
However, in practicality, only a few students
identified smart as being the only power differential.
It may be that other sources of power differential are
more beneficial to assess.
In addition, prevalence rates in this study were
higher than rates reported in some of the prior
research using definition-first measures [Nansel et al.,
2001, 2004; Solberg and Olweus, 2003] and peernomination methods [Juvonen et al., 2003]. Higher
response rates on the CBVS and the Swearer Survey
raise questions about whether the sample in this
study truly experienced higher rates of bullying or
whether inflated rates were a product of the
methodology used in this evaluation. Yet, validity
analyses support the categories yielded by the CBVS
as students whose responses resulted in the bullied
status also reported the lowest levels of well-being.
In developing the CBVS, we were particularly
interested to determine whether it would be possible
to include all three definitional characteristics of
bullying in a self-report measure. We did this by
asking a series of questions, so participants did not
have to remember all three definitional components
at once. Prior research has found that very few
children naturally incorporate power differential and
repetition in self-generated definitions of ‘‘bullying’’
[Vaillancourt et al., 2008]. Although definition-first
measures commonly embed a statement about power
differential in their description of bullying and
subsequently ask students to rate the frequency of
victimization, to our knowledge, only one other study
has explicitly incorporated items measuring power
differential in bullying assessment [Hunter et al.,
2007]. This study found considerably higher rates of
depressive symptoms among students who met
California Bullying Victimization Scale 245
criteria for all components of the bullying definition.
Similarly, Solberg and Olweus [2003] found that
frequent victimization was associated with greater
internalizing and externalizing problems.
Preliminary analysis indicated a significant, but
not fully overlapping relation between repetition of
victimization and power differential endorsement. It
is possible that these two groups of victims have
different relations to outcome variables. In the
future, it will be important to determine whether
all three components of the definition of bullying are
equally associated with psychological well-being, or
whether repetition, intentionality, and power imbalance may be unequally weighted in their impact
or differentially associated with outcomes.
LIMITATIONS AND FUTURE DIRECTIONS
This study is an initial demonstration that the
CBVS appears to have promise as a psychometrically
sound measure, but some limitations deserve mention. First, the CBVS is a self-report measure and
there have not yet been any data collected from other
informants or through observation to confirm the
validity of the measure. Even though other studies of
bullying have found limited agreement between
informants [Rønning et al., 2009], it would be useful
to assess agreement between self-, teacher-, and peerinformant detection of students who were bullied
victims vs. peer victims. Self-report alone may be
subject to misattribution of aggression, which can
lead to overidentification of bullying, or shame and
fear of repercussions, which can lead to underestimation of bullying [Card and Hodges, 2008].
Second, the CBVS does not yet distinguish
students who are purely victims of bullying from
those who are also bullies. This is in development.
Identifying bullies is associated with a new set of
challenges; however, evidence suggests that students
who are both bullies and victims (bully-victims)
should be considered a separate group from pure
victims as their profiles differ and are associated
with worse outcomes [Nansel et al., 2004; Solberg
et al., 2007]. Future iterations of the CBVS will
explore identification of bullies, using similar
strategies to evaluate power differential in relationships. Likewise, bullying can be seen as a peer group
process [Salmivalli, 1998, 1999, 2010], and other
participant roles, such as reinforcer and defender,
deserve assessment and study to better inform
intervention efforts.
A third limitation of this study is a question of the
generalizability of the sample. As noted earlier, rates
of bullying among the students surveyed were higher
than is typical in bullying research, even for the
definition-first measure that was coadministered
with the CBVS. Although data were collected from
four different schools, all schools were located
within the central coastal region of California, with
a predominantly White and Latino/a student
population. We have a strong interest to expand
our administration of the CBVS to students and
schools in other locations.
CONCLUSION
Although there is a significant amount of research
dedicated to peer victimization and bullying, this
discipline is affected by a lack of measurement
precision. Measures that have been thoroughly
developed to estimate prevalence within broad
populations have been adapted for individual
difference analyses without revalidation. For bullying
scholarship to advance, it is critical to have
consistently high standards for psychometric testing
of instruments before implementation in research or
in practice. We developed the CBVS to address gaps
between the definition and theory of bullying and
the way bullying is measured. In this preliminary
study, the CBVS reliably assessed the multiple
components of bullying and validly distinguish
between nonvictims, peer victims, and bullied
victims. Results also indicated that these distinctions
are important for identifying students most impacted by victimization experiences. Overall, these
findings suggest that the CBVS has promise to be
included in a new generation of bullying assessments
that are valid for use in research and in practice to
study the individual-level impacts of bullying.
Ultimately, the aim is for the CBVS to become an
early screening in a multigating assessment, by
which students with high CBVS scores will be
referred for a more in-depth interview to determine
the extent to which they are involved in bullying and
identify mechanisms of the bullying relationship that
can inform interventions. For example, a student
who reports being bullied by a single classmate may
need an intervention directed at that dyadic relationship in the context of their classroom. However, a
student who is repeatedly bullied by multiple
individuals across different settings may benefit
from the equivalent of a functional behavioral
analysis to understand the process by which bullying
is occurring and guide intervention for that particular student [Colvin et al., 1998]. In addition, a
classroom or school-wide intervention aimed at
Aggr. Behav.
246 Felix et al.
addressing bullying behavior and the supporting
roles of assistant to the bully, or reinforcer
[Salmivalli, 1999] would be indicated. A multigating
assessment framework provides school-wide data
to derive large-scale prevention and intervention
efforts, while offering detailed information about
students who are bullied that can have practical
implications for the targeted delivery of interventions for individuals.
ACKNOWLEDGMENTS
The project was supported by the Field Initiated
Studies Program from the Hamilton Fish Institute
with funding from the United States Office of
Juvenile Justice and Delinquency Prevention via
George Washington University. Additional information about the California Bully Victimization
Scale is available from the first author.
REFERENCES
Arora CMJ. 1996. Defining bullying: Towards a clearer general
understanding and more effective intervention strategies. Sch
Psychol Int 17:317–329. DOI: 10.1177/0143034396174002.
Björkvist K, Ekman K, Lagerspetz K. 1982. Bullies and victims. Their
ego picture, ideal ego picture, and normative ego picture. Scand J
Psychol 23:307–313. DOI: 10.1111/j.1467-9450.1982.tb00445.x.
Card NA, Hodges EVE. 2008. Peer victimization among schoolchildren: Correlations, causes, consequences, and considerations
in assessment and intervention. Sch Psychol Q 23:451–461. DOI:
10.1037/a0012769.
Chan JHF. 2006. Systemic patterns in bullying and victimization.
Sch Psychol Int 27:352–369. DOI: 10.1177/0143034306067289.
Chan JHF, Myron R, Crawshaw M. 2005. The efficacy of nonanonymous measures of bullying. Sch Psychol Int 26:443–458.
DOI: 10.1177/0143034305059020.
Colvin G, Tobin T, Beard K, Hagan S, Sprague J. 1998. The school
bully: Assessing the problem, developing interventions, and
future research directions. J Behav Educ 8:293–319. DOI:
10.1023/A:1022819213727.
Cornell DG, Brockenbrough K. 2004. Identification of bullies and
victims: A comparison of methods. In: Furlong MJ, Morrison G,
Skiba R, Cornell D (eds). Issues in School Violence Research.
New York, NY: Haworth Press, pp 63–87.
Cornell DG, Sheras PL, Cole JC. 2006. Assessment of bullying. In:
Jimerson SR, Furlong MJ (eds). Handbook of School Violence
and School Safety. Mahwah, NJ: Erlbaum, pp 587–602.
Cortina LM, Swan S, Fitzgerald LF, Waldo C. 1998. Sexual
harassment and assault: Chilling the climate for women in
academia. Psychol Women Q 22:419–441.
Craig WM, Pepler D, Atlas R. 2000. Observations of bullying in the
playground and in the classroom. Sch Psychol Int 21:22–36. DOI:
10.1177/0143034300211002.
Crick NR, Grotpeter JK. 1995. Relational aggression, gender, and
social-psychological adjustment. Child Dev 66:710–722. DOI:
10.2307/1131945.
Espelage DL, Swearer SM. 2003. Research on school bullying and
victimization: What have we learned and where do we go from
here? Sch Psychol Rev 32:365–383.
Aggr. Behav.
Felix ED, McMahon SD. 2006. Gender and multiple forms of peer
victimization: How do they influence adolescent psychosocial
adjustment? Violence Vict 21:707–724. DOI: 10.1891/vv-v21i6a003.
Felix ED, McMahon SD. 2007. The role of gender in peer
victimization among youth: A study of incidence, interrelations,
and social cognitive correlates. J Sch Violence 6:3–22.
Fitzgerald LF, Ormerod AJ. 1991. Perceptions of sexual harassment:
The influence of gender and academic context. Psychol Women Q
15:281–294.
Furlong MJ, Sharkey JD, Felix ED, Tanigawa D, Green JG. 2010.
Bullying assessment: A call for increased precision of selfreporting procedures. In: Jimerson SR, Swearer SM,
Espelage DL (eds). Handbook of Bullying in Schools:
An International Perspective. New York, NY: Routledge,
pp 329–345.
Greif JL, Furlong MJ. 2006. The assessment of school bullying:
Using theory to inform practice. J Sch Violence 5:33–50. DOI:
10.1300/J202v05n03_04.
Hamby SL, Finkelhor D. 2000. The victimization of children:
Recommendations for assessment and instrument development.
J Am Acad Child Adolesc Psychiatry 39:829–840. DOI: 10.1097/
00004583-200007000-00011.
Hawkins DL, Pepler DJ, Craig WM. 2001. Naturalistic observations
of peer interventions in bullying. Soc Dev 10:512–527. DOI:
10.1111/1467-9507.00178.
Henry DB. 2006. Associations between peer nominations, teacher
ratings, self-reports, and observations of malicious and disruptive
behavior. Assessment 13:241–252. DOI: 10.1177/1073191106287668.
Huebner ES. 1991. Correlates of life satisfaction in children. Sch
Psychol Int 12:231–240. DOI: 10.1177/0143034391123010.
Huebner ES, Suldo SM, Valois RF. 2005. Children’s life satisfaction.
In: Moore KA, Lippman LH (eds). What do Children Need to
Flourish? New York, NY: Springer, pp 41–59. DOI: 10.1007/
0-387-23823-9-4.
Hunter SC, Boyle JME, Warden D. 2007. Perceptions and correlates
of peer victimization and bullying. Br J Educ Psychol 77:797–810.
DOI: 10.1348/000709906X171046.
Juvonen J, Graham S, Schuster MA. 2003. Bullying among young
adolescents: The strong, the weak, and the troubled. Pediatrics
112:231–1237. DOI: 10.1542/peds.112.6.1231.
Kert AS, Codding RS, Tryon GS, Shiyko M. 2010. Impact of the
word ‘‘bully’’ on the reported rate of bullying behavior. Psychol
Sch 47:193–204. DOI: 10.1002/pits.20464.
Kyriakides L, Kaloyirou C, Lindsay G. 2006. An analysis of the
Revised Olweus Bully/Victim Questionnaire using the Rasch
measurement model. Br J Educ Psychol 76:781–801. DOI:
10.1348/000709905X53499.
Lee T, Cornell D. 2010. Concurrent validity of the Olweus Bully/
Victim Questionnaire. J Sch Violence 9:1–18. DOI: 10.1080/
15388220903185613.
McNeely C. 2005. Connection to school. In: Moore KA, Lippman LH
(eds). What do Children Need to Flourish? New York, NY:
Springer, pp 289–303. DOI: 10.1007/0-387-23823-9-18.
McMeely C, Nonnemaker JM, Blum RW. 2002. Promoting school
connectedness: Evidence from the National Longitudinal Study
of Adolescent Health. J Sch Health 72:138–146. DOI: 10.1111/
j.1746-1561.2002.tb06533.x.
Menesini E, Fonzi A, Smith PK. 2002. Attribution of meanings to
terms related bullying: A comparison between teacher’s and
pupil’s perspectives in Italy. Eur J Psychol Educ 17:393–406.
Nansel TR, Overpeck M, Pilla RS, Ruan WJ, Simons-Morton B,
Scheidt P. 2001. Bullying behaviors among U.S. youth: Prevalence and association with psychosocial adjustment. J Am Med
Assoc 285:2094–2100. PMid:15289243 PMCid:2556236.
California Bullying Victimization Scale 247
Nansel TR, Craig W, Overpeck MD, Saluja G, Ruan WJ and the
Health Behaviour in School-aged Children Bullying Analyses
Working Group. 2004. Cross-national consistency of the relationship
between bullying behaviors and psychosocial adjustment. Arch
Pediatr Adolesc Med 158:730–736. DOI: 10.1001/archpedi.158.8.730.
Naylor P, Cowie H, Cossin F, de Bettencourt R, Lemme F. 2006.
Teachers’ and pupils’ definitions of bullying. Br J Educ Psychol
76:553–576. DOI: 10.1348/000709905X52229.
Olweus D. 1993. Bullying at School: What We Know and What We
Can Do. Malden, MA: Blackwell.
Olweus D. 1996. The Revised Olweus Bully/Victim Questionnaire.
Mimeo. Bergen, Norway: Research Center for Health Promotion
(HEMIL Center), University of Bergen.
Ortega R, Mora-Merchán JA, Singer M, Smith PK, Pereira B,
Menesini E. 2001. Final report of the working group on general
survey questionnaires and nomination methods concerning
bullying. Retrieved on September 14, 2010, from http://
www.gold.ac.uk/tmr/reports/aim2_seville1.html.
Paludi MA. 1997. Sexual harassment in schools. In: O’Donahue W
(ed.). Sexual Harassment: Theory, Research, and Treatment.
Boston, MA: Allyn and Bacon, pp 225–240.
Rigby K. 2004. What It Takes to Stop Bullying in Schools: An
Examination of the Rationale and Effectiveness of School-Based
Interventions. In: Furlong MJ, Bates MP, Smith DC, Kingery P
(eds). Appraisal and Prediction of School Violence. Hauppauge,
NY: Nova Science, pp 165–191.
Rivers I, Smith PK. 1994. Types of bullying behavior and
their correlates. Aggr Behav 20:359–368. DOI: 10.1002/10982337(1994)20:5o359::AID-AB248020050343.0.CO;2-J.
Rønning JA, Sourander A, Kumpulainen K, Tamminen T,
Niemelä S, Moilanen I, Helenius H, Piha J, Almqvist F. 2009.
Cross-informant agreement about bullying and victimization
among eight-year-olds: Whose information best predicts psychiatric caseness 10-15 years later? Soc Psychiatry Psychiatr
Epidemiol 44:15–22. DOI: 10.1007/s00127-008-0395-0.
Rosen PJ, Milich R, Harris MJ. 2007. Victims of their own
cognitions: Implicit social cognitions, emotional distress, and
peer victimization. J Appl Dev Psychol 28:211–226. DOI:
10.1016/j.appdev.2007.02.001.
Salmivalli C. 1998. Intelligent, attractive, well-behaving, unhappy:
The structure of adolescents’ self-concept and its relations to
their social behavior. J Res Adolesc 8:333–354. DOI: 10.1207/
s15327795jra0803_3.
Salmivalli C. 1999. Participant role approach to school bullying:
Implications for interventions. J Adolesc 22:453–459. DOI:
10.1006/jado.1999.0239.
Salmivalli C. 2010. Bullying and the peer group: A review. Aggr
Violent Behav 15:112–120. DOI: 10.1016/j.avb.2009.08.007.
Schäfer M, Werner NE, Crick NR. 2002. A comparison of two
approaches to the study of negative peer treatment: General
victimization and bully/victim problems among German
schoolchildren. Br J Dev Psychol 20:281–306. DOI: 10.1348/
026151002166451.
Smith PK, Cowie H, Olafsson RF, Liefooghe APD. 2002. Definitions
of bullying: A comparison of terms used, and age and gender
differences, in a fourteen-country international comparison. Child
Dev 73:1119–1133. DOI: 10.1111/1467-8624.00461.
Snyder CR. 2005. Measuring hope in children. In: Moore KA,
Lippman LH (eds). What do Children Need to Flourish?
New York, NY: Springer, DOI: 10.1007/0-387-23823-9-5.
Solberg ME, Olweus D. 2003. Prevalence estimation of school
bullying with the Olweus Bully/Victim Questionnaire. Aggr
Behav 29:239–268. DOI: 10.1002/ab.10047.
Solberg ME, Olweus D, Endresen IM. 2007. Bullies and victims at
school: Are they the same pupils? Br J Educ Psychol 77:441–464.
DOI: 10.1348/000709906X105689.
Swearer SM. 2001. Bully Survey. Unpublished survey. Lincoln, NE:
University of Nebraska-Lincoln. As retrieved on September 6,
2010, from http://www.targetbully.com/Bully_Survey.php.
Terry T, Huebner ES. 1995. The relationship between self-concept
and life satisfaction in children. Soc Indicators Res 35:39–52.
DOI: 10.1007/BF01079237.
Vaillancourt T, McDougall P, Hymel S, Krygsman A, Miller J,
Stiver K, Davis C. 2008. Bullying: Are researchers and children/
youth talking about the same thing? Int J Behav Dev 486–495.
DOI: 10.1177/0165025408095553.
Varjas K, Henrich CC, Meyers J. 2009. Urban middle school
students’ perceptions of bullying, cyberbullying, and school safety.
J Sch Violence 8:159–176. DOI: 10.1080/15388220802074165.
You S, Furlong MJ, Felix ED, Sharkey JD, Tanigawa D, Green JG.
2008. Relations among school connectedness, hope, life satisfaction, and bully victimization. Psychol Sch 45:446–460. DOI:
10.1002/pits.20308.
Aggr. Behav.